{"id":416,"date":"2021-11-03T11:55:46","date_gmt":"2021-11-03T11:55:46","guid":{"rendered":"http:\/\/18.141.20.153\/?p=416"},"modified":"2025-08-21T10:02:28","modified_gmt":"2025-08-21T10:02:28","slug":"how-to-do-event-driven-programming-using-aws-lambda-with-amazon-kinesis-streams","status":"publish","type":"post","link":"https:\/\/learning.workfall.com\/learning\/blog\/how-to-do-event-driven-programming-using-aws-lambda-with-amazon-kinesis-streams\/","title":{"rendered":"How to do event-driven programming using AWS Lambda with Amazon Kinesis Streams?"},"content":{"rendered":"<span class=\"rt-reading-time\" style=\"display: block;\"><span class=\"rt-label rt-prefix\">Reading Time: <\/span> <span class=\"rt-time\">4<\/span> <span class=\"rt-label rt-postfix\">minutes<\/span><\/span>\n<p><strong><img src=\"https:\/\/lh4.googleusercontent.com\/1YeLvYRjL4WKkUr-p6uiSitm37aKT2pIUKnDg8rp-1bkGRSQ2x1GL7uQYAtli9R10xoMVZI66xxSe1_w5Y-WjFCgwRLouEOeb_hcuVJJhJLPaYgiHyAdXBwLZjB9WNP1zPDBYQcYcIL4Yufeb478u2i2oytzpiiPhEFMji6khhuDWDd7pDPNb6EGnn5Z\" style=\"width: 1600px;\"><\/strong><\/p>\n\n\n\n<p class=\"has-text-align-justify\">Amazon Kinesis is an AWS-managed service that processes streaming data at a massive scale. Using Amazon Kinesis, data could be easily sent to various sources like <a href=\"https:\/\/www.workfall.com\/learning\/blog\/how-to-fetch-contents-of-json-files-stored-in-amazon-s3-using-express-js-and-aws-sdk\/\">S3<\/a>, <a href=\"https:\/\/www.workfall.com\/learning\/blog\/how-to-store-query-and-index-json-data-using-aws-documentdb\/\">DynamoDB<\/a>, <a href=\"https:\/\/www.workfall.com\/learning\/blog\/whats-new-in-amazon-redshift-serverless\/\">Redshift<\/a>, and <a href=\"https:\/\/www.workfall.com\/learning\/blog\/how-to-trigger-lambda-function-using-amazon-cloudwatch-events-and-configure-cloudwatch-alarm-to-get-email-notifications-using-amazon-sns-part-1\/\">Lambda<\/a>. Kinesis is used to process hundreds of terabytes of data per hour.<\/p>\n\n\n\n<p class=\"has-text-align-justify\">AWS LAMBDA works as an event-driven computing service in the cloud. Lambda has various characteristics such as it executes your code when required and scales automatically, from a few requests per day to thousands per second. Because of these features, we can use lambda to efficiently build data processing triggers to process streaming data stored in Amazon Kinesis.<\/p>\n\n\n\n<p class=\"has-text-align-justify\">Let\u2019s do a quick hands-on to understand the functioning of AWS lambda with <a href=\"https:\/\/aws.amazon.com\/kinesis\/\" target=\"_blank\" rel=\"noreferrer noopener\">Amazon Kinesis<\/a> Streams. To get started, go to services and select Amazon Kinesis. We will be redirected to the page shown below.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh6.googleusercontent.com\/I9nitNmYkuT7aDTCkF3d7wdDd4tLja8Z63YyqR2GZTDglaTAKPzCnTZQY3VUErQkafC8oAvhnf2cOo9NaN1K-HNR4H8my1LtX4YBjsijmGBvXEllAwngM3_Nkbl3RX_645_PQj3Knjw75VRlNmt4K6UqxDOwtiyXKwt43RibvppprttTj8ZlD8o87k6kcehx9CMH\" alt=\"\"\/><\/figure>\n\n\n\n<p>Select Kinesis data streams and click on Create data stream.<\/p>\n\n\n\n<p>Now, mention the data stream name. here, we will give the number of open shards as 1.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh5.googleusercontent.com\/80aq_LhN5nh4yJw18EpWXAdrRb1pOgaXoqFS8p2zdMuHXZa5oYsS9QxgzMZ4vCdANHcvR4SoP7w1HxMWXnC0VKzLSpJFgW_c5K6inbxNnyU7pgrkND9SiNmNVHpQnWhVPHEOrAzKnMUqUfv9qCFU9FC27IDQeUndhrZ5j8BMsLn89EA4Vjq2j5QN4aHCs1aOQTbB\" alt=\"How to do event-driven programming using AWS Lambda with Amazon Kinesis Streams?\"\/><\/figure>\n\n\n\n<p>Total data stream capacity is calculated based on the number of shards. Click on Create data stream.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh4.googleusercontent.com\/qusnWLtQ6W0H_OUHqWW0O1oTBaVMqJxAxYi6J6e_E31XsIQTomnara2znn0PuiL8ZTemwv6gVkg3nIE5f8d8ej-pCAph8D57s5-avE0LU_X48zKJKvqRmwBrgwKvYlZN67fFhSz9tXboRERrdEsk6OMIJjk1nEMdkjLBUjxYRVUXa7Me5_aGwiMSIz4C6SZ9Slx5\" alt=\"How to do event-driven programming using AWS Lambda with Amazon Kinesis Streams?\"\/><\/figure>\n\n\n\n<p>Our kinesis stream is created successfully. Now, go to services and select lambda.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh4.googleusercontent.com\/ke0n2LahX7G_tLkoT6JkJCoSt4DVnfsBBDUM1WiGg5UdgwTVkJo2Sx8AMfTBGNiRCHfezneW5ic7XhUK-tU1cVl31JU4wngph2ceRrPGZhwZVE1vjoN1yDbRF4-ssOcxbEZmYtBWzTx8hvn0e-QD3op4nE96TQEtNbsx3raJrlpoJOwLjOsR0-isDmJWKE_MvNxq\" alt=\"\"\/><\/figure>\n\n\n\n<p>The below page pops up. Click on Create Function.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh3.googleusercontent.com\/4J8lYX-ChBYogh6StaJojrlnAKW0rLjwwt-3489G6ycK7k89pH_FcFUoNRkpNntnbkrS3BrLC2XQ0Y_MmX4UdF9sNmwlb-3vOEGvVd3dYYIGEzypyNQGPPxENVu7oreY5ZlR1iPC3mYzY1hVm67EDWcNQfJ8qWOX5gdeEqNwxIYclIu-75lpPcMc2REvz3-BLCRa\" alt=\"How to do event-driven programming using AWS Lambda with Amazon Kinesis Streams?\"\/><\/figure>\n\n\n\n<p>Choose to Use a blueprint option to create your function.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh6.googleusercontent.com\/PF3B9xaYy1ArU3STSXINS85IeDqL_xKUXTNFHEHY_G0LhqaKM-v-InGna7_A_9_JBDQ2dpHUYWeWhAAMuGwPxbm0o7uxi0NO4WSlLqP3aoUkNOGBCwB5fzZQXdvdRY5damAdEgYMyEWtPDLv2ZvdJ6D1bvRk53mX_0XZHTXNcT7RnXwJKYzHa8G2ygbZqcGuyoZZ\" alt=\"\"\/><\/figure>\n\n\n\n<p>Now, choose Kinesis-process-record-python from the search option.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh3.googleusercontent.com\/CyUgK4vgLVMR-EZzZuBnpLKxB-lzN5tDZmFEsUfJDO77gpNzG8asWhGv6RjbMPlxfsWhcE0SAXFr650IlqwML9SRFcPiK9IBfrSyo6dN0DaENE4B8GiYSu7gCF-cGP_3lHAyJbPxPfs3TPE9gkIgu6zzweg9Y1y_1HQ-lRyTV7afDD0QdW1DmHOhSYGh5aX3Bvxe\" alt=\"How to do event-driven programming using AWS Lambda with Amazon Kinesis Streams?\"\/><\/figure>\n\n\n\n<p>Select the blueprint name as shown below and click on configure.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh6.googleusercontent.com\/XVinH2YsddSakf1mlAu9WLuc7vNdrm_457KLyQnCvkSSkAh4l-QIBn27Ib7Sxf46l9KrPic9N1Cq9iKpwGFea33T9AwyDjz9Xh2tfTnRItiKQPCgQjPFcDCITT2YX5ggM9MHPlVnp_BRjEizuX7Dr3s6yKFUf6sS0F_E_-OLlTStH0kuyCEtarmO_d_QMSf6yb9g\" alt=\"\"\/><\/figure>\n\n\n\n<p class=\"has-text-align-justify\">Enter the function name. Now we must Create an IAM role that should have the permission <strong>AWSLambdaKinesisExecutionRole. <\/strong>So, that lambda function can read items from Kinesis and write logs to Cloudwatch Logs.<\/p>\n\n\n\n<p>Here, we are using an existing IAM role.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh4.googleusercontent.com\/g9albPKBCqLGNo0T-gcnBDHHgZgv5N_pX_rDHAoYneKU_UPEWd-kzNw2N4HOQsYgp__NqQ8-salumAJadf3RmOW6ic8JHGDL48OZpUtEWHlCeYIhgzHdBsQ_Wv97UiLH89LZx7l5mIi3MQ30Rivz-qJGZ06H8zYR34SoJVfg0M4M4U5c455-EMIpxHSzVgwEXuoB\" alt=\"How to do event-driven programming using AWS Lambda with Amazon Kinesis Streams?\"\/><\/figure>\n\n\n\n<p>Now, we will scroll down and add the Kinesis stream name that we created before from the dropdown.&nbsp;<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh4.googleusercontent.com\/e_Em4QtpU_paBHwY28AGhDu4QC6DO9VMMDgi0-xeoizy0TbsXvEAs5_OuiCDPUT613IHXKY6nWNLZs18Xq0hZRAGcN965UarQZl1M_FBQE_CmBrUk5fng8rxYWtLfpXzg-TC5jWESkaAYa87h2RIf4HJUYPcZ90L95CgVPCrdQQGVacWaG6fgVSdUpEVhs7INp1k\" alt=\"How to do event-driven programming using AWS Lambda with Amazon Kinesis Streams?\"\/><\/figure>\n\n\n\n<p>Check the <strong>Enable trigger<\/strong> box to add a trigger to the lambda function.&nbsp;<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh3.googleusercontent.com\/wSi9w0QZ-X186udQ8Dofb6DjRdIYnbXf68MGTU1DyPV5_hkpeYGO6_pocZkLDtB1AqpFos25E8dNr-i91I0mfX9oWo92SSbiPMgt6m7NtvkZ2E7uVNEdncYaoWZowWmfZ7uJSq69D75eC9ZzidWg3CZJzb1s2vStOnBoiUm-HDpi8HUpoorBtYcVpwBok9d5bqQp\" alt=\"\"\/><\/figure>\n\n\n\n<p>Here, you can see the lambda function code. Now, click on create function.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh3.googleusercontent.com\/jB7uGGbexFizUS0Fld6u1xD9omOne_UKGHQS5usEjiuKw7wJPHdVtuBT9uLJ3kUr2GOBZRrdk49nROQ2K-KMDZoV1j7MzhzR4SY-Dzqz3NiURi7ynskTNjMQIChyvomVJSXBwxTyQCDjszFZNSrjBWWsg8n_GT3Y2daUT2Jkg2W8cd9A5ArA6ncmtxrejmOPbgVx\" alt=\"How to do event-driven programming using AWS Lambda with Amazon Kinesis Streams?\"\/><\/figure>\n\n\n\n<p>Our lambda function <strong>Kinesis-data-process<\/strong> is created successfully.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh4.googleusercontent.com\/Vbs5BSBRISJzbq4d1phDKufSkeF1Fm0F7NRIUxOPebyyqV4zwINwNcZFt2nBIORuVfO-kMQA9zBShgWh68-dwzd-_ahRvYXXqC0gq-s85Z3Ye9kdHbGegGXsh44dnjlrLMtJrambMr3DurV0itV1IFQ6Vi_GHMrWtDyQhX3McsXHMYYyeHkM70Lizo9tplXUYBO9\" alt=\"\"\/><\/figure>\n\n\n\n<p>Here, the function code is available.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh4.googleusercontent.com\/skqWcDv01r7AA-aXsCzuW9D5bJktixwYvstajs7Ea41CQMKPYzCriK1yrfqxcGuzUo3j0U2O-5oK-kenWuuplUIabmWmE6QdUNnzYeIgW6ZsJnzePm_uyGWf6UAZWAaAJpyLSH8TfSs-VhzdW9BHbyFBcP-3g7I6gmDKMnHIjtgXowXlrUjEpXP0hY6dj9HucTMI\" alt=\"How to do event-driven programming using AWS Lambda with Amazon Kinesis Streams?\"\/><\/figure>\n\n\n\n<p>Now, click on Test. Mention the Event name and click save.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh3.googleusercontent.com\/RQoEZjMmMcooJptSlV864uVzTv0Vr2FTtBzA9ESmvQIW_-0a9ROzDrErjiyvQT6fMJACfvdE4Mfr1DNym8LDkJI7K3eJbrIs7b9GUG3qs1m8ifxci2U2nDIM4hAK8_IobQqh7CcawJTt8kVmZ2kAZ0NFwBt7xHAb9ynpLrmbGiqMvMBgYcx35W1-asPyT8Xe1pVG\" alt=\"\"\/><\/figure>\n\n\n\n<p>Again, click on Test to test the function.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh3.googleusercontent.com\/XRkkowRqy-6pkE0I8EHQJQ2OmsbBD1ECUh_urHZIiA42fN6UEPq0j2zDg8b8LHZMv5vG585hUDQPrzXaLsNYSjE3P1pqwKd6-JmBzogaqcqb7XAiTWBh1sircyvP6fT2pxXNFog2AzftaumqJa4Gn2_-nbR88XPjtMXYab5IPqrl7DuRme3_qIinfNuuG6egEUER\" alt=\"How to do event-driven programming using AWS Lambda with Amazon Kinesis Streams?\"\/><\/figure>\n\n\n\n<p>Now, we will see the execution result \u201cSuccessfully processed 1 records.\u201d<\/p>\n\n\n\n<p>You will be shown information about the Lambda execution:<\/p>\n\n\n\n<p>Execution duration<\/p>\n\n\n\n<p>Resources consumed<\/p>\n\n\n\n<p>Maximum memory used<\/p>\n\n\n\n<p>Log output<\/p>\n\n\n\n<p>Again click on test. Then click on test 2-3 times, so that the CloudWatch logs are created for the same.&nbsp;<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh3.googleusercontent.com\/miokkQ-LLRbXA-F7GGCQ7GaxMY6W0Pugl8eXsdgN9iYKJhUdhSvAgA1wBpFm1VcU_qDzoU_mGdksK508GVBSMqV9bTsY6M3yWTg2DdsWAxgspnGR0jhoUrUIJsU9ozjNKd5eoBk6c7QF_cjZLUOgKTi2chs5aAklAW-53wV1iUxGa3lH8HhtoOVFZyk7NyCc0s8M\" alt=\"\"\/><\/figure>\n\n\n\n<p>Go to the monitoring tab. Here, we will find the CloudWatch metrics for Invocations, Duration, Error count etc.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh3.googleusercontent.com\/aPaihxAn7vCwflyb79OTiLud7qSlPwvR4VaeNtHUiZz8evLOgxfVNoSwuOCFp-CLZYD-uqPpnaQagNBXSieD_uTJzS84EcMTnl1R2ROtjrPqfgsqOQrqhR3npz-BcrdCaxXHDkR9DR9gxsMGskS6ODR1pPN1Tw-N6B4RnobXkfgMyY9judk5YPcQeoNGOUAT90js\" alt=\"How to do event-driven programming using AWS Lambda with Amazon Kinesis Streams?\"\/><\/figure>\n\n\n\n<p>The CloudWatch metrics are shown below.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh4.googleusercontent.com\/Ld0IfTaMz8Q_ty2Fe9idtnUs6aM_HwexEy6mg3HoNCBtSbOCZqjjE9SpeypMA584AW2d8512Agw5ifNSFDLeZREOwiO16TTY46P_P5SBcbmtTuGvoedXDuYdRkQrcJ20kNFiP0Z85QDtkq0gB8AnSx7F_3smA66zgNyUqS6A01ahCx0knDthXaB-x5BqlM-5FWGg\" alt=\"\"\/><\/figure>\n\n\n\n<p>Here, we will see the CloudWatch logs insights.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh3.googleusercontent.com\/Y2i3nKU4UFqWugH1env0Uai_GMhEkz5hqmH-jkPKY1AP5ZSSIEE38MGG-06NVmMZUYoK46Qafi3XBUhmcvjkCgSakq5r-spXCpsdhFtmHHLtPmSsX8LkTvG2wsIL5Vwk-MzwZQUTDp6DG3sUL_3QWdgnbuUuqNeuILiz7Hn5eLbJUp7_MrOl3Zwy9FTEmHqN6dDF\" alt=\"\"\/><\/figure>\n\n\n\n<p>This is how we can do event-driven programming using AWS Lambda with Amazon Kinesis Streams.<\/p>\n\n\n\n<p>Hope this information is helpful. We will keep sharing more about how to use new AWS services. Stay tuned!&nbsp;<\/p>\n\n\n\n<p>Meanwhile \u2026<\/p>\n\n\n\n<p><strong>Keep Exploring -&gt; Keep Learning -&gt; Keep Mastering<\/strong><\/p>\n","protected":false},"excerpt":{"rendered":"<p><span class=\"rt-reading-time\" style=\"display: block;\"><span class=\"rt-label rt-prefix\">Reading Time: <\/span> <span class=\"rt-time\">4<\/span> <span class=\"rt-label rt-postfix\">minutes<\/span><\/span> Amazon Kinesis is an AWS-managed service that processes streaming data at a massive scale. Using Amazon Kinesis, data could be easily sent to various sources like S3, DynamoDB, Redshift, and Lambda. Kinesis is used to process hundreds of terabytes of data per hour. AWS LAMBDA works as an event-driven computing service in the cloud. Lambda [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":417,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"spay_email":""},"categories":[2],"tags":[125,3,57,6],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v19.1 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>How to do event-driven programming using AWS Lambda with Amazon Kinesis Streams? - The Workfall Blog<\/title>\n<meta name=\"description\" content=\"Using Amazon Kinesis, data could be easily sent to various sources like S3, DynamoDB, Redshift, and Lambda.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/learning.workfall.com\/learning\/blog\/how-to-do-event-driven-programming-using-aws-lambda-with-amazon-kinesis-streams\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How to do event-driven programming using AWS Lambda with Amazon Kinesis Streams? - The Workfall Blog\" \/>\n<meta property=\"og:description\" content=\"Using Amazon Kinesis, data could be easily sent to various sources like S3, DynamoDB, Redshift, and Lambda.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/learning.workfall.com\/learning\/blog\/how-to-do-event-driven-programming-using-aws-lambda-with-amazon-kinesis-streams\/\" \/>\n<meta property=\"og:site_name\" content=\"The Workfall Blog\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/facebook.com\/workfall\" \/>\n<meta property=\"article:published_time\" content=\"2021-11-03T11:55:46+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-08-21T10:02:28+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/learning.workfall.com\/learning\/blog\/wp-content\/uploads\/2021\/11\/Kinesis.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"628\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@workfall\" \/>\n<meta name=\"twitter:site\" content=\"@workfall\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Workfall\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"7 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Organization\",\"@id\":\"https:\/\/learning.workfall.com\/learning\/blog\/#organization\",\"name\":\"Workfall - Hire #Kickass Coders On Demand\",\"url\":\"https:\/\/learning.workfall.com\/learning\/blog\/\",\"sameAs\":[\"https:\/\/www.instagram.com\/workfall\/\",\"https:\/\/www.linkedin.com\/company\/workfall\/\",\"https:\/\/facebook.com\/workfall\",\"https:\/\/twitter.com\/workfall\"],\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/learning.workfall.com\/learning\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/i1.wp.com\/18.141.20.153\/learning\/blog\/wp-content\/uploads\/2021\/10\/cropped-WF_logo.png?fit=400%2C400\",\"contentUrl\":\"https:\/\/i1.wp.com\/18.141.20.153\/learning\/blog\/wp-content\/uploads\/2021\/10\/cropped-WF_logo.png?fit=400%2C400\",\"width\":400,\"height\":400,\"caption\":\"Workfall - Hire #Kickass Coders On Demand\"},\"image\":{\"@id\":\"https:\/\/learning.workfall.com\/learning\/blog\/#\/schema\/logo\/image\/\"}},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/learning.workfall.com\/learning\/blog\/#website\",\"url\":\"https:\/\/learning.workfall.com\/learning\/blog\/\",\"name\":\"The Workfall Blog\",\"description\":\"#Tech #Remote #Jobs\",\"publisher\":{\"@id\":\"https:\/\/learning.workfall.com\/learning\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/learning.workfall.com\/learning\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/learning.workfall.com\/learning\/blog\/how-to-do-event-driven-programming-using-aws-lambda-with-amazon-kinesis-streams\/#primaryimage\",\"url\":\"https:\/\/learning.workfall.com\/learning\/blog\/wp-content\/uploads\/2021\/11\/Kinesis.png\",\"contentUrl\":\"https:\/\/learning.workfall.com\/learning\/blog\/wp-content\/uploads\/2021\/11\/Kinesis.png\",\"width\":1200,\"height\":628,\"caption\":\"Amazon Kinesis Streams\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/learning.workfall.com\/learning\/blog\/how-to-do-event-driven-programming-using-aws-lambda-with-amazon-kinesis-streams\/#webpage\",\"url\":\"https:\/\/learning.workfall.com\/learning\/blog\/how-to-do-event-driven-programming-using-aws-lambda-with-amazon-kinesis-streams\/\",\"name\":\"How to do event-driven programming using AWS Lambda with Amazon Kinesis Streams? - The Workfall Blog\",\"isPartOf\":{\"@id\":\"https:\/\/learning.workfall.com\/learning\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/learning.workfall.com\/learning\/blog\/how-to-do-event-driven-programming-using-aws-lambda-with-amazon-kinesis-streams\/#primaryimage\"},\"datePublished\":\"2021-11-03T11:55:46+00:00\",\"dateModified\":\"2025-08-21T10:02:28+00:00\",\"description\":\"Using Amazon Kinesis, data could be easily sent to various sources like S3, DynamoDB, Redshift, and Lambda.\",\"breadcrumb\":{\"@id\":\"https:\/\/learning.workfall.com\/learning\/blog\/how-to-do-event-driven-programming-using-aws-lambda-with-amazon-kinesis-streams\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/learning.workfall.com\/learning\/blog\/how-to-do-event-driven-programming-using-aws-lambda-with-amazon-kinesis-streams\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/learning.workfall.com\/learning\/blog\/how-to-do-event-driven-programming-using-aws-lambda-with-amazon-kinesis-streams\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/learning.workfall.com\/learning\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"How to do event-driven programming using AWS Lambda with Amazon Kinesis Streams?\"}]},{\"@type\":\"Article\",\"@id\":\"https:\/\/learning.workfall.com\/learning\/blog\/how-to-do-event-driven-programming-using-aws-lambda-with-amazon-kinesis-streams\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/learning.workfall.com\/learning\/blog\/how-to-do-event-driven-programming-using-aws-lambda-with-amazon-kinesis-streams\/#webpage\"},\"author\":{\"@id\":\"https:\/\/learning.workfall.com\/learning\/blog\/#\/schema\/person\/cab8236044692bc5b27606b13167794a\"},\"headline\":\"How to do event-driven programming using AWS Lambda with Amazon Kinesis Streams?\",\"datePublished\":\"2021-11-03T11:55:46+00:00\",\"dateModified\":\"2025-08-21T10:02:28+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/learning.workfall.com\/learning\/blog\/how-to-do-event-driven-programming-using-aws-lambda-with-amazon-kinesis-streams\/#webpage\"},\"wordCount\":487,\"publisher\":{\"@id\":\"https:\/\/learning.workfall.com\/learning\/blog\/#organization\"},\"image\":{\"@id\":\"https:\/\/learning.workfall.com\/learning\/blog\/how-to-do-event-driven-programming-using-aws-lambda-with-amazon-kinesis-streams\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/learning.workfall.com\/learning\/blog\/wp-content\/uploads\/2021\/11\/Kinesis.png\",\"keywords\":[\"Amazon Kinesis Streams\",\"AWS\",\"lambda\",\"workfall\"],\"articleSection\":[\"AWS Cloud Computing\"],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/learning.workfall.com\/learning\/blog\/#\/schema\/person\/cab8236044692bc5b27606b13167794a\",\"name\":\"Workfall\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/learning.workfall.com\/learning\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/learning.workfall.com\/learning\/blog\/wp-content\/uploads\/2023\/09\/avatar_user_1_1693914404-96x96.png\",\"contentUrl\":\"https:\/\/learning.workfall.com\/learning\/blog\/wp-content\/uploads\/2023\/09\/avatar_user_1_1693914404-96x96.png\",\"caption\":\"Workfall\"},\"sameAs\":[\"https:\/\/www.workfall.com\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"How to do event-driven programming using AWS Lambda with Amazon Kinesis Streams? - The Workfall Blog","description":"Using Amazon Kinesis, data could be easily sent to various sources like S3, DynamoDB, Redshift, and Lambda.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/learning.workfall.com\/learning\/blog\/how-to-do-event-driven-programming-using-aws-lambda-with-amazon-kinesis-streams\/","og_locale":"en_US","og_type":"article","og_title":"How to do event-driven programming using AWS Lambda with Amazon Kinesis Streams? - The Workfall Blog","og_description":"Using Amazon Kinesis, data could be easily sent to various sources like S3, DynamoDB, Redshift, and Lambda.","og_url":"https:\/\/learning.workfall.com\/learning\/blog\/how-to-do-event-driven-programming-using-aws-lambda-with-amazon-kinesis-streams\/","og_site_name":"The Workfall Blog","article_publisher":"https:\/\/facebook.com\/workfall","article_published_time":"2021-11-03T11:55:46+00:00","article_modified_time":"2025-08-21T10:02:28+00:00","og_image":[{"width":1200,"height":628,"url":"https:\/\/learning.workfall.com\/learning\/blog\/wp-content\/uploads\/2021\/11\/Kinesis.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_creator":"@workfall","twitter_site":"@workfall","twitter_misc":{"Written by":"Workfall","Est. reading time":"7 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Organization","@id":"https:\/\/learning.workfall.com\/learning\/blog\/#organization","name":"Workfall - Hire #Kickass Coders On Demand","url":"https:\/\/learning.workfall.com\/learning\/blog\/","sameAs":["https:\/\/www.instagram.com\/workfall\/","https:\/\/www.linkedin.com\/company\/workfall\/","https:\/\/facebook.com\/workfall","https:\/\/twitter.com\/workfall"],"logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/learning.workfall.com\/learning\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/i1.wp.com\/18.141.20.153\/learning\/blog\/wp-content\/uploads\/2021\/10\/cropped-WF_logo.png?fit=400%2C400","contentUrl":"https:\/\/i1.wp.com\/18.141.20.153\/learning\/blog\/wp-content\/uploads\/2021\/10\/cropped-WF_logo.png?fit=400%2C400","width":400,"height":400,"caption":"Workfall - Hire #Kickass Coders On Demand"},"image":{"@id":"https:\/\/learning.workfall.com\/learning\/blog\/#\/schema\/logo\/image\/"}},{"@type":"WebSite","@id":"https:\/\/learning.workfall.com\/learning\/blog\/#website","url":"https:\/\/learning.workfall.com\/learning\/blog\/","name":"The Workfall Blog","description":"#Tech #Remote #Jobs","publisher":{"@id":"https:\/\/learning.workfall.com\/learning\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/learning.workfall.com\/learning\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/learning.workfall.com\/learning\/blog\/how-to-do-event-driven-programming-using-aws-lambda-with-amazon-kinesis-streams\/#primaryimage","url":"https:\/\/learning.workfall.com\/learning\/blog\/wp-content\/uploads\/2021\/11\/Kinesis.png","contentUrl":"https:\/\/learning.workfall.com\/learning\/blog\/wp-content\/uploads\/2021\/11\/Kinesis.png","width":1200,"height":628,"caption":"Amazon Kinesis Streams"},{"@type":"WebPage","@id":"https:\/\/learning.workfall.com\/learning\/blog\/how-to-do-event-driven-programming-using-aws-lambda-with-amazon-kinesis-streams\/#webpage","url":"https:\/\/learning.workfall.com\/learning\/blog\/how-to-do-event-driven-programming-using-aws-lambda-with-amazon-kinesis-streams\/","name":"How to do event-driven programming using AWS Lambda with Amazon Kinesis Streams? - The Workfall Blog","isPartOf":{"@id":"https:\/\/learning.workfall.com\/learning\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/learning.workfall.com\/learning\/blog\/how-to-do-event-driven-programming-using-aws-lambda-with-amazon-kinesis-streams\/#primaryimage"},"datePublished":"2021-11-03T11:55:46+00:00","dateModified":"2025-08-21T10:02:28+00:00","description":"Using Amazon Kinesis, data could be easily sent to various sources like S3, DynamoDB, Redshift, and Lambda.","breadcrumb":{"@id":"https:\/\/learning.workfall.com\/learning\/blog\/how-to-do-event-driven-programming-using-aws-lambda-with-amazon-kinesis-streams\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/learning.workfall.com\/learning\/blog\/how-to-do-event-driven-programming-using-aws-lambda-with-amazon-kinesis-streams\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/learning.workfall.com\/learning\/blog\/how-to-do-event-driven-programming-using-aws-lambda-with-amazon-kinesis-streams\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/learning.workfall.com\/learning\/blog\/"},{"@type":"ListItem","position":2,"name":"How to do event-driven programming using AWS Lambda with Amazon Kinesis Streams?"}]},{"@type":"Article","@id":"https:\/\/learning.workfall.com\/learning\/blog\/how-to-do-event-driven-programming-using-aws-lambda-with-amazon-kinesis-streams\/#article","isPartOf":{"@id":"https:\/\/learning.workfall.com\/learning\/blog\/how-to-do-event-driven-programming-using-aws-lambda-with-amazon-kinesis-streams\/#webpage"},"author":{"@id":"https:\/\/learning.workfall.com\/learning\/blog\/#\/schema\/person\/cab8236044692bc5b27606b13167794a"},"headline":"How to do event-driven programming using AWS Lambda with Amazon Kinesis Streams?","datePublished":"2021-11-03T11:55:46+00:00","dateModified":"2025-08-21T10:02:28+00:00","mainEntityOfPage":{"@id":"https:\/\/learning.workfall.com\/learning\/blog\/how-to-do-event-driven-programming-using-aws-lambda-with-amazon-kinesis-streams\/#webpage"},"wordCount":487,"publisher":{"@id":"https:\/\/learning.workfall.com\/learning\/blog\/#organization"},"image":{"@id":"https:\/\/learning.workfall.com\/learning\/blog\/how-to-do-event-driven-programming-using-aws-lambda-with-amazon-kinesis-streams\/#primaryimage"},"thumbnailUrl":"https:\/\/learning.workfall.com\/learning\/blog\/wp-content\/uploads\/2021\/11\/Kinesis.png","keywords":["Amazon Kinesis Streams","AWS","lambda","workfall"],"articleSection":["AWS Cloud Computing"],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/learning.workfall.com\/learning\/blog\/#\/schema\/person\/cab8236044692bc5b27606b13167794a","name":"Workfall","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/learning.workfall.com\/learning\/blog\/#\/schema\/person\/image\/","url":"https:\/\/learning.workfall.com\/learning\/blog\/wp-content\/uploads\/2023\/09\/avatar_user_1_1693914404-96x96.png","contentUrl":"https:\/\/learning.workfall.com\/learning\/blog\/wp-content\/uploads\/2023\/09\/avatar_user_1_1693914404-96x96.png","caption":"Workfall"},"sameAs":["https:\/\/www.workfall.com"]}]}},"jetpack_featured_media_url":"https:\/\/learning.workfall.com\/learning\/blog\/wp-content\/uploads\/2021\/11\/Kinesis.png","jetpack-related-posts":[{"id":611,"url":"https:\/\/learning.workfall.com\/learning\/blog\/trigger-lambda-function-using-amazon-cloudwatch-events-and-configure-cloudwatch-alarm-to-get-email-notifications-using-amazon-sns-part-1\/","url_meta":{"origin":416,"position":0},"title":"How to trigger Lambda function using Amazon CloudWatch events and configure CloudWatch alarm to get email notifications using Amazon SNS (Part 1)?","date":"November 11, 2021","format":false,"excerpt":"Whether you're considering a cloud migration or have already made the switch to AWS, you'll want to know how to manage your digital environment. With Amazon CloudWatch, AWS makes monitoring simple. CloudWatch is the cornerstone of your AWS infrastructure management. It has a robust framework for capturing and storing metrics\u2026","rel":"","context":"In &quot;AWS Cloud Computing&quot;","img":{"alt_text":"Amazon CloudWatch - Workfall","src":"https:\/\/i2.wp.com\/learning.workfall.com\/learning\/blog\/wp-content\/uploads\/2021\/11\/cloudwatch1.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":541,"url":"https:\/\/learning.workfall.com\/learning\/blog\/how-to-build-a-serverless-event-driven-workflow-with-aws-glue-and-amazon-eventbridgepart-1\/","url_meta":{"origin":416,"position":1},"title":"How to build a serverless event-driven workflow with AWS Glue and Amazon EventBridge(Part 1)?","date":"November 10, 2021","format":false,"excerpt":"Have you ever wondered how huge IT companies construct their ETL pipelines for production? Are you curious about how TBs and ZBs of data are effortlessly captured and rapidly processed to a database or other storage for data scientists and analysts to use? The answer is the serverless data integration\u2026","rel":"","context":"In &quot;AWS Cloud Computing&quot;","img":{"alt_text":"AWS Glue","src":"https:\/\/i1.wp.com\/learning.workfall.com\/learning\/blog\/wp-content\/uploads\/2021\/11\/Glue.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":599,"url":"https:\/\/learning.workfall.com\/learning\/blog\/serverless-event-driven-workflow-with-aws-glue-and-amazon-eventbridgepart-2\/","url_meta":{"origin":416,"position":2},"title":"How to build a serverless event-driven workflow with AWS Glue and Amazon EventBridge(Part 2)?","date":"November 11, 2021","format":false,"excerpt":"In microservices, maintaining loose coupling within distributed systems remains a difficulty. In the long run, even loosely coupled architectures tend to become tightly coupled. It becomes increasingly more difficult for enterprises to ensure that each service is healthy as all APIs are built into sophisticated workflows. If you want to\u2026","rel":"","context":"In &quot;AWS Cloud Computing&quot;","img":{"alt_text":"Amazon EventBridge - Workfall","src":"https:\/\/i0.wp.com\/learning.workfall.com\/learning\/blog\/wp-content\/uploads\/2021\/11\/eventbridge.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":461,"url":"https:\/\/learning.workfall.com\/learning\/blog\/how-to-trigger-lambda-function-using-amazon-cloudwatch-events-and-configure-cloudwatch-alarm-to-get-email-notifications-using-amazon-snspart-2\/","url_meta":{"origin":416,"position":3},"title":"How to trigger Lambda function using Amazon CloudWatch events and configure CloudWatch alarm to get email notifications using Amazon SNS(Part 2)?","date":"November 9, 2021","format":false,"excerpt":"Modern applications such as those running on microservices architectures generate large volumes of data in the form of metrics, logs, and events. Amazon CloudWatch enables you to collect, access, and correlate this data on a single platform from across all your AWS resources, applications, and services that run on AWS.\u2026","rel":"","context":"In &quot;AWS Cloud Computing&quot;","img":{"alt_text":"How to trigger Lambda Function using Amazon CloudWatch Events?","src":"https:\/\/i0.wp.com\/learning.workfall.com\/learning\/blog\/wp-content\/uploads\/2021\/11\/cloudwatch2.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":310,"url":"https:\/\/learning.workfall.com\/learning\/blog\/how-can-we-use-amazon-comprehend-with-aws-lambda-and-amazon-lex-for-sentiment-analysispart-2\/","url_meta":{"origin":416,"position":4},"title":"How can we use Amazon Comprehend with AWS Lambda and Amazon Lex for Sentiment Analysis?","date":"November 1, 2021","format":false,"excerpt":"In our previous blog, How can we use Amazon Comprehend with AWS Lambda and Amazon Lex for Sentiment Analysis(Part 1)? we have discussed NLP, Amazon Comprehend as one of the best NLP services, its features, benefits, use cases, etc. In this blog, we will demonstrate how to configure Amazon Comprehend\u2026","rel":"","context":"In &quot;AWS Cloud Computing&quot;","img":{"alt_text":"How to use AWS Comprehend for Sentiment Analysis","src":"https:\/\/i2.wp.com\/learning.workfall.com\/learning\/blog\/wp-content\/uploads\/2021\/11\/comprehend.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":504,"url":"https:\/\/learning.workfall.com\/learning\/blog\/how-to-use-aws-textract-to-extract-data-from-any-image-pdf\/","url_meta":{"origin":416,"position":5},"title":"How to use Amazon Textract to extract data from any Image & PDF?","date":"November 10, 2021","format":false,"excerpt":"Amazon Textract is a highly scalable machine learning service that collects printed text, handwriting, and other information from scanned documents automatically.\u00a0\u00a0\u00a0 Using Amazon Textract, you can easily extract text and data from images and any scanned documents that go beyond simple optical character recognition (OCR) to extract data from tables\u2026","rel":"","context":"In &quot;AWS Cloud Computing&quot;","img":{"alt_text":"How to use AWS Textract to extract data from any Image & PDF","src":"https:\/\/i0.wp.com\/learning.workfall.com\/learning\/blog\/wp-content\/uploads\/2021\/11\/Textract.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]}],"_links":{"self":[{"href":"https:\/\/learning.workfall.com\/learning\/blog\/wp-json\/wp\/v2\/posts\/416"}],"collection":[{"href":"https:\/\/learning.workfall.com\/learning\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/learning.workfall.com\/learning\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/learning.workfall.com\/learning\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/learning.workfall.com\/learning\/blog\/wp-json\/wp\/v2\/comments?post=416"}],"version-history":[{"count":5,"href":"https:\/\/learning.workfall.com\/learning\/blog\/wp-json\/wp\/v2\/posts\/416\/revisions"}],"predecessor-version":[{"id":2196,"href":"https:\/\/learning.workfall.com\/learning\/blog\/wp-json\/wp\/v2\/posts\/416\/revisions\/2196"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/learning.workfall.com\/learning\/blog\/wp-json\/wp\/v2\/media\/417"}],"wp:attachment":[{"href":"https:\/\/learning.workfall.com\/learning\/blog\/wp-json\/wp\/v2\/media?parent=416"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/learning.workfall.com\/learning\/blog\/wp-json\/wp\/v2\/categories?post=416"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/learning.workfall.com\/learning\/blog\/wp-json\/wp\/v2\/tags?post=416"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}