{"id":164,"date":"2021-10-27T05:35:35","date_gmt":"2021-10-27T05:35:35","guid":{"rendered":"http:\/\/18.141.20.153\/?p=164"},"modified":"2023-05-08T11:34:28","modified_gmt":"2023-05-08T11:34:28","slug":"how-to-deploy-amazon-ec2-p4d-instances-in-ec2-ultraclusters-to-get-highest-performance-for-ml-training-and-hpc-in-the-cloud","status":"publish","type":"post","link":"https:\/\/learning.workfall.com\/learning\/blog\/how-to-deploy-amazon-ec2-p4d-instances-in-ec2-ultraclusters-to-get-highest-performance-for-ml-training-and-hpc-in-the-cloud\/","title":{"rendered":"How to deploy Amazon EC2 P4d instances in EC2 UltraClusters to get highest performance for ML training and HPC in the Cloud?"},"content":{"rendered":"<span class=\"rt-reading-time\" style=\"display: block;\"><span class=\"rt-label rt-prefix\">Reading Time: <\/span> <span class=\"rt-time\">11<\/span> <span class=\"rt-label rt-postfix\">minutes<\/span><\/span>\n<p><img src=\"https:\/\/lh4.googleusercontent.com\/R338yR515ntIkbWzIEB6dEwU_2nNXEUWgoVTuWl1NtT2_t7OZB7U_BkALO3gcYwGxzaVW_ceHj5jcif4pOQIbU7A-OpUJmjUt8-JRomDXFasRqQF1u9RZtJ6ZQwb6cceT40SOEMffl6k12Y3bWbdGw\" style=\"width: 1600px;\"><\/p>\n\n\n\n<p class=\"has-text-align-justify\"><a href=\"https:\/\/www.workfall.com\/learning\/blog\/15-awsome-years-of-amazon-ec2-and-still-going-strong\/\">Amazon EC2<\/a> P4d instances deliver the highest performance for machine learning (ML) training and high-performance computing (HPC) applications in the cloud. Amazon EC2 P4d instances are deployed in hyperscale clusters called EC2 UltraClusters that comprise the high-performance compute, networking, and storage in the cloud. Each EC2 UltraCluster of P4d instances comprises more than 4,000 of the latest NVIDIA A100 GPUs, Petabit-scale non-blocking networking infrastructure, and high throughput low latency storage with FSx for Lustre. Customers can easily scale from a few to thousands of NVIDIA A100 GPUs in the EC2 UltraClusters based on their ML or HPC project needs. Unlike on-premises systems, customers can access virtually unlimited compute and storage capacity, scale their infrastructure based on business needs, and spin up a multi-node ML training job or a tightly coupled distributed HPC application in minutes, without any setup or maintenance costs. This blog will help you launch a high-performance HPC cluster in the cloud using EC2 UltraClusters of P4d Instances. You will set up the underlying networking for the cluster, deploy <a href=\"https:\/\/www.workfall.com\/learning\/blog\/how-to-launch-and-run-feature-rich-and-highly-performant-file-systems-using-amazon-fsx\/\">FSx<\/a> for Lustre and P4d cluster, and delete your AWS resources.\u00a0<\/p>\n\n\n\n<p>In this blog, we will cover:<\/p>\n\n\n\n<ul><li>Amazon EC2 P4d Instances<\/li><li>Features of Amazon EC2 P4d Instances<\/li><li>Performance of Amazon EC2 P4d instances<\/li><li>Use cases of Amazon EC2 P4d instances<\/li><li>Hands-on &#8211; Deploy Amazon EC2 P4d instances in EC2 UltraClusters<\/li><li>Conclusion<\/li><\/ul>\n\n\n\n<h2>Amazon EC2 P4d Instances<\/h2>\n\n\n\n<p class=\"has-text-align-justify\"><a href=\"https:\/\/aws.amazon.com\/ec2\/instance-types\/p4\/\" target=\"_blank\" rel=\"noreferrer noopener\">Amazon EC2 P4 instances<\/a>, the latest generation of GPU-based instances deliver the best performance for machine learning training and high-performance computing in the cloud.<\/p>\n\n\n\n<p class=\"has-text-align-justify\">P4d instances are deployed in EC2 UltraClusters, which are hyper-scale clusters. Each EC2 UltraCluster has over 4,000 NVIDIA A100 Tensor Core GPUs, Petabit-scale networking, and scalable low-latency storage using FSx for Lustre. Each EC2 UltraCluster is one of the most powerful supercomputers in the world. In EC2 SuperClusters, anyone can quickly spin up P4d instances.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh3.googleusercontent.com\/n8pswb-y6CLonHiCEPlW772RcpFC6d7wl0Xeox5OKbsnPE5RA0E34JKob4lf2afkcVgvP7Dw3H5SJy3V3GXJhkqeyraI-K4VFhUO8bjDEhTrbE4hkvT24q_-rPYpejbNGHd_HZiVPQ5BMW4sPe_z3Q\" alt=\"How to deploy Amazon EC2 P4d instances in EC2 UltraClusters to get highest performance for ML training and HPC in the Cloud?\"\/><\/figure>\n\n\n\n<p>The key specifications of P4d instances are:<\/p>\n\n\n\n<ul><li>Elastic Fabric Adapter (EFA)<\/li><li>Enhanced Networking<\/li><li>EBS Optimized<\/li><li>Intel AVX, Intel AVX2, Intel AVX-512, and Intel Turbo<\/li><li>3.0 GHz 2nd Generation Intel Xeon Scalable (Cascade Lake) processors<\/li><\/ul>\n\n\n\n<h2>Features of Amazon EC2 P4d Instances<\/h2>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh6.googleusercontent.com\/KEpEMZa18zcqv-zVtQkQvVijBTSRUmrGvkes2Oiw6DylJ3hfuQ0JBcaoZ9Z-Zy-GhN4S0qgNnSG7e4yKu7A9pScrbOfXL2wcWJ3NdiSJAazwSLXNnW8fwlIzkfAUimu1G_ApI5TTWoh49kYhdf0cdA\" alt=\"How to deploy Amazon EC2 P4d instances in EC2 UltraClusters to get highest performance for ML training and HPC in the Cloud?\"\/><\/figure>\n\n\n\n<p>The following are the features of P4d Instances:<\/p>\n\n\n\n<ul><li>Up to 8 NVIDIA A100 Tensor Core GPUs<\/li><li>400 Gbps instance networking with support for Elastic Fabric Adapter (EFA) and NVIDIA GPUDirect RDMA (remote direct memory access)<\/li><li>600 GB\/s peer-to-peer GPU communication with NVIDIA NVSwitch<\/li><li>3.0 GHz 2nd Generation Intel Xeon Scalable (Cascade Lake) processors<\/li><li>Deployed in EC2 UltraClusters consisting of more than 4,000 NVIDIA A100 Tensor Core GPUs, Petabit-scale networking, and scalable low latency storage with Amazon FSx for Lustre<\/li><\/ul>\n\n\n\n<h2>Performance of Amazon EC2 P4d instances<\/h2>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh6.googleusercontent.com\/nT02BziDiZY4p0EKTCZup_5XdHWx4guUywdOljhfaf-LO2Wu7cioK0TAhr-YOfvL3oBcPiv8BJpiqJva349VO_hDZ2c2I2FHG41iY2IGXA0UK42fj1efTXZLLoDPCjm0ryBisyXe-f6NJQcKPqHCww\" alt=\"Performance of Amazon EC2 P4d instances\"\/><\/figure>\n\n\n\n<p class=\"has-text-align-justify\"><strong>Natural Language Processing: <\/strong>For a BERT-Large model using the TensorFlow framework trained on the Wikipedia-corpus dataset, P4d instances are 3x faster than the P3 instances.<\/p>\n\n\n\n<p class=\"has-text-align-justify\"><strong>Image Classification: <\/strong>For a ResNet50 model using the TensorFlow framework trained on the Imagenet2012 dataset, P4d instances are 2.1x faster than the P3 instances.<\/p>\n\n\n\n<p class=\"has-text-align-justify\"><strong>Speech To Text:<\/strong> For a Jasper model using the PyTorch framework trained on the LibriSpeech dataset, P4d instances are 2.3x faster than the P3 instances.<\/p>\n\n\n\n<h2>Use cases of Amazon EC2 P4d instances<\/h2>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh3.googleusercontent.com\/97rj61AwZbPqxJ_jWjsMnY36UCnDNi72hjqElOlaynVwHlBzzUOhbXOjed1jZC-g241wfeD1x42fWNvb62xItczVRqdLDHp9b3yCtkmGhjF6ACGXIVo0WU_7_t37WSaPxZYx0GVsYBzg3e_5YDswzg\" alt=\"Use cases of Amazon EC2 P4d instances\"\/><\/figure>\n\n\n\n<p class=\"has-text-align-justify\">Machine learning workloads such as natural language comprehension, perception model training for autonomous vehicles, picture classification, object recognition, and recommendation engines are among the applications.&nbsp;<\/p>\n\n\n\n<p class=\"has-text-align-justify\">Increased GPU speed can help customers train larger, more complicated models in less time, while extra GPU memory can help customers train larger, more complex models. P4&#8217;s improved processing performance and GPU memory can be used for seismic analysis, drug discovery, DNA sequencing, and insurance risk modeling by HPC clients.<\/p>\n\n\n\n<h2>Hands-on- Deploy Amazon EC2 P4d instances in EC2 UltraClusters<\/h2>\n\n\n\n<p class=\"has-text-align-justify\">We will demonstrate how we can launch a high-performance HPC cluster in the cloud using EC2 UltraClusters of P4d Instances. Amazon EC2 P4d instances deliver the highest performance for machine learning (ML) training and high-performance computing (HPC) applications in the cloud. These instances are the first in the cloud to support 400 Gbps instance networking. P4d instances provide up to 60% lower cost to train ML models, including an average of 2.5x better performance for deep learning models compared to previous generation P3 and P3dn instances. Researchers, data scientists, and developers can leverage P4d instances to train ML models for use cases such as natural language processing, object detection and classification, and recommendation engines, as well as run HPC applications such as pharmaceutical discovery, seismic analysis, and financial modeling. EC2 UltraClusters of P4d instances combine high-performance compute, networking, and storage into one of the most powerful supercomputers in the world. Navigating to the VPC dashboard, we will first create a private subnet in a VPC. Then we will navigate to the NAT Gateway dashboard and create a new NAT gateway with the private subnet attached. We will then create a route table thereby editing its routing entries and the subnet associations. To access the EC2 UltraCluster, we will create 2 security groups, one for EFA and the other one for external SSH. We will then launch an FSx for the Lustre file system followed by launching a cluster of EC2 P4d instances with 4 EFA ENI\u2019s. Finally, we will have a look at the steps of mounting the file system to the EC2 instance.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh3.googleusercontent.com\/5d1tRKvZvVcjGmKYawVZKRRLR9p17_R83oSYTO5EvTF1Hl34jo4EShPl1nK46q8ubOE_ErsqAe706dTTtWWdABfYUMLsjDqMgp31n_jsQcVdI9i_Smb92_QywsuRKu34q9eSCrfrjJu6K-AJWkW5ww\" alt=\"Deploy Amazon EC2 P4d instances in EC2 UltraClusters\"\/><\/figure>\n\n\n\n<p><strong>To implement this, we will do the following:<\/strong><\/p>\n\n\n\n<ul><li>Login to your AWS console and navigate to the dashboard.<\/li><li>Navigate to the VPC dashboard.<\/li><li>Create a private subnet in the selected VPC.<\/li><li>Create a NAT Gateway attaching the private subnet to it.<\/li><li>Navigate to the Route Tables dashboard and create a new Route Table.<\/li><li>Add routes to the route table and edit the subnet associations.<\/li><li>Navigate to the Security Groups dashboard in the EC2 console.<\/li><li>Create 2 security groups, one for EFA and the other one for External SSH with the shown Inbound and Outbound rules.<\/li><li>Navigate to the S3 console and create a new bucket that is to be linked to the File System.<\/li><li>Navigate to the File System dashboard and create a new file system with the configuration steps shown below.<\/li><li>Once the file system becomes available, navigate to the EC2 dashboard and launch a P4d instance following the steps shown below.<\/li><li>Add 3 more network interfaces with Elastic fabric Adapter checked while creating the instance.<\/li><li>Once launched, you can access the instance via the command line using SSH and mount the file system using the steps provided.<\/li><li>Finally, you can start training the models on the P4d instance.<\/li><li>In case you are just following the hands-on for learning purposes, make sure to eliminate all the resources you created throughout the hands-on.<\/li><\/ul>\n\n\n\n<p>Login to your AWS console and navigate to the dashboard.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh4.googleusercontent.com\/ufSgD76zmhAt544psFFWWgYPfpOT8Vcb7x6jES6Y0Rz-8jrS096rzwlUFjhMIQbDmICK_lTsJ7nd70qlWyXmAsCPIzFeLu_PXZqpwRwogl4U3gWdI0K8OGD3RQ784LK1rnoM8ZOxMVaEN34jOlbUXg\" alt=\"\"\/><\/figure>\n\n\n\n<p>Search for the VPC service and navigate to the VPC dashboard.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh5.googleusercontent.com\/K3De0x0Om9-OlolRYLvrulym0MhR9P2qgiBdb8EsKmaTS9b37W72RVKQ_6OJYp_D9NIB4nzq-s26EQDq_SSWQxFAQHLBSdMZYWavAKOJ39eFbymYL7dXYGzdSTnMSpvqbYcoDe3SsM7JjlmNZgifEA\" alt=\"How to deploy Amazon EC2 P4d instances in EC2 UltraClusters to get highest performance for ML training and HPC in the Cloud?\"\/><\/figure>\n\n\n\n<p>Select subnets from the left navigation pane.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh5.googleusercontent.com\/J5Qck-CzwNW1Cnykj5s2Q1YAcCiPbGIWBHLvCMiQD2t55fqtyKIviI2oz95mNphyCRHSsfxSV6_U-yoSYro2MBWWmyFD6zLJuig5CDwQmZ4Zgk14PNb6qrt5BcjP-rgh17yU9JCIVIzwExDCb1PyJg\" alt=\"\"\/><\/figure>\n\n\n\n<p>Click on Create Subnet.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh6.googleusercontent.com\/ZJvjIvmaD0j3W1mDgJ_fWN7ZAQM5GjlntUSlQ5QPBn1DgT5O7yKszmeSmcTMplHTBCJdc5J2VDiddtrnNBawPmgdwt_cIbp5BCv8OJHr8M89sVifDa9L39Wp8DZko2e7iMTCWbajFFplPUUjgPT0Qw\" alt=\"How to deploy Amazon EC2 P4d instances in EC2 UltraClusters to get highest performance for ML training and HPC in the Cloud?\"\/><\/figure>\n\n\n\n<p>Choose the VPC from the dropdown.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh6.googleusercontent.com\/1XdmbGRAwoMc-OftF5wS6eNVXN_aQiL1f8vh2Iz5g9SwFexk69ggxlXYG57ai68kbZrDvfxKl8EIgcN1oAQfR5Vlr-RCN0qkfytZANGfqqJAtieOZ7thYPOz-sLrbkNe9Q5TQWjdHDfxtT1SdW4plg\" alt=\"\"\/><\/figure>\n\n\n\n<p class=\"has-text-align-justify\">Enter a name for the subnet and select an availability zone. Enter the IPv4 in the IPv4 CIDR Block as per the selected VPC. Enter Tags if needed. Click on Create Subnet.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh4.googleusercontent.com\/AmcjF6HpbJ6xrIahLrXq52TORlfMIoD3J4j5HckQQmcZftLmXAOgD2g2LgKu5EpPgvLyDjTr8SgWEoBexv93y1SwygZfnwy-AjsQKXMu8X-zUtRX1QQoDXuwA9vF50fc2a1r3YaIoB1UXHqmdBxVOw\" alt=\"How to deploy Amazon EC2 P4d instances in EC2 UltraClusters to get highest performance for ML training and HPC in the Cloud?\"\/><\/figure>\n\n\n\n<p>You will be able to see the created subnet in the list of subnets. Select NAT gateways from the left navigation pane.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh5.googleusercontent.com\/FAG0PDtKjVYECfi2LU1Ys4lrVuTSEkgsUYDwONIUn6cmi_9cs-8z9ogYWveQSl0UvGKFOBxfV03SSrIDF9SVDRWGhbggUM-vFMTNWRl9Aw_OH6rKLKpJ6Kv-05PhgFYCPfA924bcb30D0LrAJamXrw\" alt=\"\"\/><\/figure>\n\n\n\n<p>Click on Create NAT gateway.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh3.googleusercontent.com\/tSp0AqYza64wQoMV-Ydu_S9zXTILmd8uKWaqJYTuCmxNCOjMggIe5gXObdnMgvx8Uyt6hUlVzIPdzGIuI9qBHYYjr8GJUefOCjRBdAy9KIX_JQHmEnaq46ra2uYtdByvyzYSa_0BATmQo3lgJgvpoA\" alt=\"How to deploy Amazon EC2 P4d instances in EC2 UltraClusters to get highest performance for ML training and HPC in the Cloud?\"\/><\/figure>\n\n\n\n<p>Enter a name for your NAT gateway and choose the options as shown in the image below.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh5.googleusercontent.com\/2XUv3Ys63rw5bBaP6DzadcUg7Eqbz6UYEmS9JKFGT8k96zbH2aHhO2ZaFxJBvqwSnVlhQnj2s81iwQx9hxARLISj0sXkJBTeGCp8we6uGO2Av0DMGzjm1IXGIL7SV3dfvjsfQqul3os_Jw6z9Nppjw\" alt=\"\"\/><\/figure>\n\n\n\n<p>Enter Tags if any need for your NAT gateway. Click on Create NAT gateway.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh6.googleusercontent.com\/NJQhMidEXg2wkcaoPXTLtdPppQ5nEBZQzKnGFe_hbFV1bnzxVPYf4SrDCeKuvt6nq8_3OPtSRMU1AeJk7N2mJNi34Uy6eSyogW5IqPz4mSKBqEHilHItYXINhINr6SY_DEQAZDkE9kbk5przLZ1JQQ\" alt=\"How to deploy Amazon EC2 P4d instances in EC2 UltraClusters to get highest performance for ML training and HPC in the Cloud?\"\/><\/figure>\n\n\n\n<p>On success, you will see the screen as shown below.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh4.googleusercontent.com\/0-r7gzdMdDXT4VH0jE66JpGllum82f08gtn7Ga0-YCxmKJx_O1y1whSIn9cujZ3bZd8qu0Hp6C6Kmj7Ew2n1-P0u_9ljD4WxYariPJ_cMp2sgpUxdTkvs8Agjfcl1UwRJN8b0xXh5dpFn56Taz8uVw\" alt=\"\"\/><\/figure>\n\n\n\n<p>Select Route Tables from the left navigation pane and click on Create route table.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh6.googleusercontent.com\/NCP1Hqvl5H7ukaSzFo73v08l_cbZ6F469zT0hDzq_Whl4jFgtLsinhETQl2fEO1EqvSHAL1bdL8Cf30ltTWXEA8tdZkq1JnVsJAcP-hiAJCVizs2IMrdjpKKPSqSBmm-T6hoDpCDpV6KHEz5Tv5iSQ\" alt=\"How to deploy Amazon EC2 P4d instances in EC2 UltraClusters to get highest performance for ML training and HPC in the Cloud?\"\/><\/figure>\n\n\n\n<p class=\"has-text-align-justify\">Enter a name for your route table. Select the VPC in which you created your subnets. Enter Tags if needed and click on Create route table.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh6.googleusercontent.com\/ZveYNtaDGUGmOUlKLGd0kTlpAX3EBAuJCGPm6E9O0VwJSQ-m0E5JGr7zPAERWROySkeRPRjrWeoLNgzHOJQpPjxXvAmw27EZ8eLayWJy0NnAKUSsFuRR26hmZ0XEB42e-geycfvYpsavLCyDquWHcg\" alt=\"\"\/><\/figure>\n\n\n\n<p>On success, you will see the screen as shown in the image below.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh5.googleusercontent.com\/nLhRTou6JX01S54SNBaXujLfcYUiHe417HmJ00kI-gPuO-3He2zcxdpZRXfA1Lt5jan9_E8H4NSda3JXTe5l1iAP1jIvcwgP6h5KWZW-WqeAyfPFNQLsItb-bIwi8qzWsg48C-jgpNf3lh1_K4_I2Q\" alt=\"How to deploy Amazon EC2 P4d instances in EC2 UltraClusters to get highest performance for ML training and HPC in the Cloud?\"\/><\/figure>\n\n\n\n<p>Scroll down to the bottom and click on Edit Routes.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh4.googleusercontent.com\/VHQVyL7pV_IxLNfgeQb2jBrQn6mYQeN2b6aTI8Cdg5n82SCJfm4gV5-veysHvrOzIhAX0Z8_a8q_4X1XOb__bOsLptGFWKsY08Q4w72ij7jiX3Tdo8VfvYzmJV7pMlKoV0wdV_s16jtOgRfvHXkGUA\" alt=\"\"\/><\/figure>\n\n\n\n<p>Make an entry in the table as shown in the image below. Click on Save Changes.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh6.googleusercontent.com\/_byg7gyDfiwhCpspyKLLAFjXy4VIKzacApXMghXPYTE4DhcoydMgDZ1tQV5dpUqWdqJRVoDRs-jBx_B5U9p9MbZvz8QB02DSFyaKSRrqxdgS4zX9lb0rIhCKrLR1eGYX6uWlGyHTcAkAL3AHWzCOOw\" alt=\"\"\/><\/figure>\n\n\n\n<p>On success, you will see the entry created in the Routes.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh5.googleusercontent.com\/9rOfwz4IHlPDerHsprMVBYy5jxZFIkduAwrZRXs6bAVmlOUl0p452vn9MnvabKVeauoIU6EtHrT46_4yweMWOYPtdT9CoiISfEs6JsPxQx55cYS8MjK1i_-eAa4AUQ1RX68vipZxVH-3BDGCSIRmEg\" alt=\"\"\/><\/figure>\n\n\n\n<p>Now, select the Subnet associations tab.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh4.googleusercontent.com\/Gf2ICCd7o6VL0qRTo8Krb73hMFcEZL4_BUys0viB0h7kTbHMwLK4ftVYsKAgFj5psUIQObdpPQ--pBaA90rJ9hOEXcBBKzlT6eqhJS5ljb5QXoqQCLSR6vSbatY3gtR6ppzNsoae0JU_CaGrQ7oSEA\" alt=\"\"\/><\/figure>\n\n\n\n<p>Or you can select the route table and click on Edit Subnet associations.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh6.googleusercontent.com\/B5K_rVrYxetH0j6etoSWzTO-UTre4gAp3wppS7y34IOCM2v6_k_hZ4h-lHZEDta2XKrXogpsx5nOxVktS8-hPnI3w_yPT7uSfRr5ldJKg0zjBFLcZSAs66C1AxOzuxM3oS-jX43mohf82SJ7SJkTpg\" alt=\"How to deploy Amazon EC2 P4d instances in EC2 UltraClusters to get highest performance for ML training and HPC in the Cloud?\"\/><\/figure>\n\n\n\n<p>Select the private subnet and click on Save association.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh5.googleusercontent.com\/Neqp3jfax5t93jSU9eKchGEuMexL99d7VxpzTAc3FLps2NC-jp1LozcTwIe7Sn8EUZApGJMrFSh-CWpmKkaxaopCAOwXl4mP6sEytyXOhT99HNdFjmDqpscCYqj12Y_KR8CgyT2jazkEzwA-MEI9aQ\" alt=\"\"\/><\/figure>\n\n\n\n<p>On success, you will see the message as shown in the image below.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh6.googleusercontent.com\/XoxJu0pCFTsoOd9l1k2TfVQHVM84r7l-KTmuHpM9uos2mz1mrTuC9v23l89WWR74KFO8OttpPAjMceezel8jMhSAtQzHK7pvU9TsVLlf24rLy3dB63RikoRSru46dqYQW--zgP56oKGx99dtnfdJeg\" alt=\"\"\/><\/figure>\n\n\n\n<p>Now, search for the EC2 service and navigate to its dashboard.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh6.googleusercontent.com\/yJhiacNLP7iOs4jxrC66MspseRwvkLxlvqWj_13a3OCk7Ekfgo3vEczkiT9Osf7jD2SE_zEIZr7Y8Ky1RWqRQDSAfOu2XUL50PzoV5FsltQydpNZEQWR0Ne9u3Inl0xygf8WTRtrL-JhRrhHkzMUgQ\" alt=\"\"\/><\/figure>\n\n\n\n<p>Select Security Groups from the left navigation pane.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh3.googleusercontent.com\/jpz0_ez8arHo7xcWLfbqJhJxKcp9y_nk73Twj65U--yg0aAACwbD3g89CD9yX7u7NqfLsnxepFH2snNkYsO7b1BtCekFgF2tj7rAKhsNEDOEX3tg9ePJWfhMTXR3o0_bOylMAAK-GyOQugoe-aiJ7A\" alt=\"How to deploy Amazon EC2 P4d instances in EC2 UltraClusters to get highest performance for ML training and HPC in the Cloud?\"\/><\/figure>\n\n\n\n<p>Click on Create security group.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh5.googleusercontent.com\/W3RddrOYFb9vKk_Ogk79KnqV1qnoQf4KegHC_s__sckRMVqi8FSD1KirReKEcWE2miXsBqcrnz2cJveLqCh2hR7iSd3WCTHds70nW6Wu2Sc-KpZmeAbz5MpMeyr3iNK2ctof9w2EZO4GzVkJE5TtCQ\" alt=\"\"\/><\/figure>\n\n\n\n<p class=\"has-text-align-justify\">Enter a name for the first security group and select the vpc in which the subnet exists. Add an inbound rule as shown in the image below.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh6.googleusercontent.com\/Gen3b_bfPz8kaQ22C2Ijd6lGlB3oAQfREvDLT7bcd_7d_6t2xgqBNwEOjBfQLokRbUSrJgwWJaWCtX7TKiulzbNzxU5AUQhV-D7UeAnN0ttZJyn_ieGTbvKDlxU2dfEgglVeMdOitUMMC3kv486BNw\" alt=\"\"\/><\/figure>\n\n\n\n<p>Add the outbound rule and tags if needed and click on Create security group.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh5.googleusercontent.com\/52idTYoTT83hGrFRJ82r4A3AHhuCXmG5inTBmAGLdxqxcTonBkXm1rr7oI7fWYu5FymFF6RB7irSYwr6wCdzR4Wsx3ttc72q-R9YH8jh7C8NMaLS2q3jenFBp-6T4CgXMAqt1DqJZ4CV35kBP5wAEQ\" alt=\"How to deploy Amazon EC2 P4d instances in EC2 UltraClusters to get highest performance for ML training and HPC in the Cloud?\"\/><\/figure>\n\n\n\n<p>Similarly, create another security group for SSH access and add the inbound rule as shown in the image below.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh3.googleusercontent.com\/PrwUrTx0PYvG7qESoKDt3oPK_vo4wGTE8I43qWc6-ndLi7T4BqtAcXq-0TCNTEKk-W8r5WiVImXTE2GkLQ6VDwATq4f9ItLO-ULuHEJih3RKugBGY5uzQRkxPdl_4USbXMuYGEeSsnzJwX59enrm1g\" alt=\"\"\/><\/figure>\n\n\n\n<p>Add the outbound rule and tags if any needed and click on Create security groups.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh3.googleusercontent.com\/wZ5wfuYbUWmcmvOp_fTpB0cjFr0hJ4Rmfg56tZV9qauaUPcg_vwtZCqY2OCMsewNhTI99oLGOogkY0F8JMOkUkc_JXmWiPaxHxCEQ4IN48ZEVGujLltowqSxjJmToDRsGMhzPSjwaVn5Hp5rmDVScg\" alt=\"How to deploy Amazon EC2 P4d instances in EC2 UltraClusters to get highest performance for ML training and HPC in the Cloud?\"\/><\/figure>\n\n\n\n<p>On success, you will see the message as shown in the image below.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh3.googleusercontent.com\/pAwTiGmpX6-GHx_k0Hm7Fx5uAdSqisNlu8KENGOTNbSUAHChPo92wJSBuwVFajrjO_1YKSaczF4Jlx737oN5i-AICm5AQmcCqRrzsQnFYPuXMNEcIAV0T6s9hOOo-8ODU69OnWZYra6K7I4J6vDzRg\" alt=\"\"\/><\/figure>\n\n\n\n<p>Navigate to the S3 console. Click on Create Bucket.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh6.googleusercontent.com\/8lK9lfwAdxR3PEIOyCAkAxEKX494Y5tvhfXPkhqjRP2jdE11s5_ERrEEvUjjPtI_aGSBN8NkDLAdpOPBzONQYH6M3UQQq1xsmtH0_H6e5qpxyiWvzoQrzDS2nE9fp_fjlxgDiVUfI6p4-Cn6wzPlfQ\" alt=\"\"\/><\/figure>\n\n\n\n<p>Enter a name for the bucket.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh4.googleusercontent.com\/JcQeAnjTGqOmsSKESl0F9jWL4MwPN1nng9gy8WfzOfggEnTpQAmgtipE89i1Z9J05qNHZdQ00wCaxHecborxkcfVts2glKZQU5nWqHNdybLOc47cJj9eJ0SaQzupgXrKykoTBV2mUQej6jashpPoAg\" alt=\"How to deploy Amazon EC2 P4d instances in EC2 UltraClusters to get highest performance for ML training and HPC in the Cloud?\"\/><\/figure>\n\n\n\n<p>Block all public access for your bucket.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh6.googleusercontent.com\/cShZx-4GglyxyL2sTLXmR0FKaW_gq9gkJCM-EdADwyRuSxKwWAHoUULTHpDQnXxGB7LHxLxYytfTNRNTAaotAjRFMLKybWgrAZ3teSXUoaGW1dG-qVBD4XEIUj4mLje3cQsvbiEGewVMQeQluSCMqg\" alt=\"\"\/><\/figure>\n\n\n\n<p>Make the changes as shown in the image below and click on Create bucket.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh3.googleusercontent.com\/3V4ApWxZxcay9_t4J_H4mfIDMan5vx0E1w1MM8X5Wv2AUekepoGz414DCPun9v8_57IkkHCn7KD5vAqniLzUZTujr19qBkNOcr6Zrb2E9LMxKFhEkyFZV_OIJiciLJqruj6A_znOWd-imp7TE9GI4w\" alt=\"\"\/><\/figure>\n\n\n\n<p>On success, you will see the message as shown in the image below.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh5.googleusercontent.com\/iuL23kOtONle054Vpm3RpOauVLLrjZMHuAHMrTa_KXXAshKnZv3YJk2fvs-3ZjzBFnMK8MHgdl5hEPsrxHXdNpSHRcOMsNxucY00Jx_25ZKQTDb_tZKAXq2oIPS7KfqVuH9fqOXssf0myKIZJiW1aA\" alt=\"\"\/><\/figure>\n\n\n\n<p>Now, search for the service FSx.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh5.googleusercontent.com\/Dm0BcHrIyMkuV-2BrveGCkrr9NZpILbwSoonLBMA3nb-jLKvVGRu2z1oqLk4e1koobsKMG87joynC-zI40YQU-Hoaz-CVhqIvhORNYfHnekvdtAoAK_UW_6_z50wI4067XItvZfNmfYaCNHQ5zfO3A\" alt=\"How to deploy Amazon EC2 P4d instances in EC2 UltraClusters to get highest performance for ML training and HPC in the Cloud?\"\/><\/figure>\n\n\n\n<p>Click on Create file system.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh4.googleusercontent.com\/DrMDelc0fyKKC7VlmDQ4KygPsyAXHsAbLE2IIWtd4Fc_uTEa1OGGvURhbt4uHGQLoqWStrnLVVQU4pw_8j_HkRNvXaua1WaC90FMQWp7uLjbpIR9wd8IUKo5HsyYB7PUwnW3uysLujgzcuPNEjUhww\" alt=\"\"\/><\/figure>\n\n\n\n<p>Select Amazon FSx for the Lustre option.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh5.googleusercontent.com\/tLF6GTSGc1ce_Wn2sh0QZMxhM83z4iYwIVvy730BgPA6J48ecreCVUoLr-OuMbfiO_waHS3PHDdrwoiRIBOff07hg7GEky3Lifv6AAUuZi5Ieq-_Jt8r-S1yIrm80euw0423PCO-BWamnbuB8jYotg\" alt=\"How to deploy Amazon EC2 P4d instances in EC2 UltraClusters to get highest performance for ML training and HPC in the Cloud?\"\/><\/figure>\n\n\n\n<p>Fill in the form similar to the screenshot shown below with the following parameters:<\/p>\n\n\n\n<p>Deployment &amp; storage type: Scratch,SSD<\/p>\n\n\n\n<p>Throughput per unit of storage: 200 MBs\/TB<\/p>\n\n\n\n<p>Storage Capacity: 2.4TiB<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh5.googleusercontent.com\/YaIf-Z7Spl9FitHEyZUt3J9Not5WnNITrUJyhHS6MaCPgINW7Ut0WtJs8zs5e7t2Tq5ehfjX4hGJSmpkrgXbwtZ3jHZqXYNMgD4a_46G7427O4N-00hZpy3bKASht1bRGEV0Zjd_neqbUCJxPQZIdQ\" alt=\"\"\/><\/figure>\n\n\n\n<p>For Network and Security:<\/p>\n\n\n\n<p>Virtual Private Cloud: VPC of the private subnet created earlier<\/p>\n\n\n\n<p>VPC Security Groups: Choose the EFA security group you created earlier<\/p>\n\n\n\n<p>Subnet: Private subnet created earlier<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh6.googleusercontent.com\/WiIWKDA7r-ugQuPlr3JHq1RMFFcW8UXVrmQ3DTyE4xd62b75x2dUXdI0XviO3kFg3MOkIGEFM-THfznf9IhhH1rcQ9awytYhhrCjEh90uJ7yJPmfSS8D4-XDuwiU-3tmUwUmC6rPJA4NDioWUJRwHA\" alt=\"How to deploy Amazon EC2 P4d instances in EC2 UltraClusters to get highest performance for ML training and HPC in the Cloud?\"\/><\/figure>\n\n\n\n<p class=\"has-text-align-justify\">Choose an S3 bucket for data ingestion that we created above and make the options as shown in the screenshot below.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh5.googleusercontent.com\/mrqNpd1gRiJiDhjre5Rr4ixB_q7t-12wgTZWm9wF4nI02Cw8IFCcm6p7Qu8q_6MRudg0n0mCdgga9OHt4b2pI2Rk4I8ou7uIUCsD9k-9B7DJEhBuoZZiXrErW8NBzSsf6CSiepRL6983JdKhG-9R3Q\" alt=\"\"\/><\/figure>\n\n\n\n<p>Review the settings and scroll down and click on Create File System.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh4.googleusercontent.com\/wAit_eGrLuCESgMzN4Cg1oBy11PegKjqizEkDjAAokLCak9NL1ZO2ESG1x2eFle5yQQBjunSIb4O2VlWWaeVNEAirGHRRSs_om3T83Jvg4Sq-Z7ABulV7NHUYffh_x3e4ZB0ne0oqsifHcgCp2Fb1g\" alt=\"\"\/><\/figure>\n\n\n\n<p>The creation might take a few minutes.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh6.googleusercontent.com\/cEaKHXa1lsA4YYFGzUbySfpLr8kJxWYqvb3ecOj1TI4NQiyElDpTMzhGtvUh-8HqBpsozulq07lPX8HUOkTuk8t9MjtxtjXJouKLrpo65PJr0xofetKdr_vzXkdGFmaclWZC-4HKdxGjxiGrZmbSvQ\" alt=\"How to deploy Amazon EC2 P4d instances in EC2 UltraClusters to get highest performance for ML training and HPC in the Cloud?\"\/><\/figure>\n\n\n\n<p>Once the status changes to Available, click on the File system name.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh6.googleusercontent.com\/Z6ni5x2hqYGmBJ08wT9rvXv_AMr95UU-Pim2QkQp-CJLscp7_qzRr5Gxr7arIR4psg-6s5zESv8DYVhoJdRsJ4JmxEu6NHF3IWSQ8BnrUmgvbIMkW6YAZA1rPSEyc-AO2NHb0XUV8Fb0oDv8bMTr0Q\" alt=\"\"\/><\/figure>\n\n\n\n<p>Note down the Mount name and you can review all the configurations made.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh3.googleusercontent.com\/Ck2ap_WUUm1qgLTEkmHe97csOSGJdFQ6CckHqwLTDZhYvBmc5KxxFUfz0TzhMkOfIYqbfuMggXuuJfgSS7LGtTfngs3002GjfJOWcLpHePYksHpL_ZjqMqZtMuqpV9g-Rerd30x98kjxEeztu9GfXQ\" alt=\"\"\/><\/figure>\n\n\n\n<p>Now, navigate back to the EC2 dashboard and click on Launch instances.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh4.googleusercontent.com\/mwtv9f4y5PBQGZpmPiSWsu2aASqzIJ0oXNi7-vh8_fVWZ6-nP3zE0quUzq4iQsT6lqlSqeaiFWWjppQUDFkcO10fxKJFvujau1B9QwDiozmWxH_vd5M1y4yzDJvHq8TIzz4DsCEK0D6bgH3Gei5dJA\" alt=\"How to deploy Amazon EC2 P4d instances in EC2 UltraClusters to get highest performance for ML training and HPC in the Cloud?\"\/><\/figure>\n\n\n\n<p>Select the AMI with A100 support as well as have the FSx client driver installed.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh6.googleusercontent.com\/6aW1b8ck2E6bsHvDP36uDiAQ2mZxkqiDnM2GkhUxqjEG6u1pdajVi7KSlNgNPyb2332M2xBzG1e9-JfP4S26vFjAc_9pRgC9_6AYbFInuP6yWjSpdjkkQQbHyegMnCau8j7XNC7Z-mw4eI3hhlkKWw\" alt=\"\"\/><\/figure>\n\n\n\n<p>For Instance, Type choose: p4d.24xlarge. Click on Next: configure instance details.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh6.googleusercontent.com\/hEsA3Mpg1SYOrCoY0cfZ7mMzgDf7ueGeBwQZfC3VTGBLjFJY0B-zqoYtCObVrw48BzDtuq6PEEtTR9jPv7SXGIX1jpYFJf9JSfsS-OIM0zV63CPJUPxMFKDxURguT61AoU91U799SUx_2uPXHEV_xQ\" alt=\"\"\/><\/figure>\n\n\n\n<p class=\"has-text-align-justify\">For the instance, details choose the number of instances you want in the count. Choose the VPC and private subnet created earlier. Select a placement group created as a cluster.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh6.googleusercontent.com\/DqIx6_wECHtyKOvsHgC9GNwZ3A0tb_KESoQm-vwKuFknrn8NYYiEOFNgPcLgnxyl9GH-qOlIOGLyR5UvRQS7rErtoEKk5NrzgEQyRZcVZ50BQFtPoOpkSXzYDVVL-BdrLTEB07TnxdZ_hva1bjZx8g\" alt=\"How to deploy Amazon EC2 P4d instances in EC2 UltraClusters to get highest performance for ML training and HPC in the Cloud?\"\/><\/figure>\n\n\n\n<p class=\"has-text-align-justify\">For network interfaces add 3 more network interfaces with \u201cElastic Fabric Adapter\u201d checked by clicking on Add Device.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh4.googleusercontent.com\/7EiEdZDHHfjynulXX7-6GomEpWGLu-mocGUo5267WfCEvzFO_vQQARidxYsCPmqNfaR0EFF2hTxdJiGArsCEWrMB1Gy4K7IsrGlApyGj7PxD4692dEXi-sbNj6Rw1tfcJvK2w1m9SIcTGWz0aXYlBw\" alt=\"\"\/><\/figure>\n\n\n\n<p>Set the NetworkCardIndex for each EFA adapter to 0,1,2,3. Click on Next: Add storage.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh4.googleusercontent.com\/CHaaK8hB71x1jcTT6sWRx9jdEPM7EipKICGJ2RBBR2DbDGmZTSH8TK6rQhRvz9rDtFdCbeRJ--sOt4lXqO-QyNN_aeWwvlkKJT-fE0dLfjPOF7DIcKmbAfxvnhrpdPewZwuNRT1XFYF1TS-6z383IQ\" alt=\"\"\/><\/figure>\n\n\n\n<p>You can add additional storage if you need any. Click on Next: tags.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh5.googleusercontent.com\/_lpUWJZXnj4ofnNYUXiPnJJXhvtaxc-3azuS3cXO9KgAP-3pYlGEYQpM2RwAgtAu-Ox8u8za_eNcXrbDRq7NyyiRgTrjzmvv5bbGMmvufBsGm8o29cVZ-gr3ZqJpvutpPtMn0HxmKGnZMNpbj8GL5w\" alt=\"How to deploy Amazon EC2 P4d instances in EC2 UltraClusters to get highest performance for ML training and HPC in the Cloud?\"\/><\/figure>\n\n\n\n<p>Add tags for your EC2 instance if needed. Click on Next: Configure Security Group.&nbsp;<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh6.googleusercontent.com\/FDp8-CDAUoU8_UBEjOE_F0vNeQ-lcdMCQwjj9I8aNoxFMs7p5XXR6SEB-VNnBx4FxKEHWdYZ_ZRpUafVHbPpaf7VO_wDvo8tyKSviEvLGI4IMOJ2j53418UhwbVVDVBEl9ExU7CbFeDpk-tNdAlGhg\" alt=\"\"\/><\/figure>\n\n\n\n<p>Choose the security groups created earlier for SSH and EFA access. Click on Review and Launch.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh3.googleusercontent.com\/kqnll0G3vinfe1TKQJYsy77zLdYn26MpzMVrzsrWKfHXCa-9T7TIl0s1CknRYX-eujf7AXG4c4rYhHAavj-aSsQWYrG0MScMiY7rHBasEdTJ1CSM0erptPzUt4W2i6FSvXzLlwHDRV1Nnls72NSj3g\" alt=\"\"\/><\/figure>\n\n\n\n<p>Review all the settings and click on Launch.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh3.googleusercontent.com\/k6yk2ouzcntMlOXkuCgD_j_-AVuAcxK5Rtd9Ido5yOIcy33nRZx7IU9RagwE99bLGGwpU_y96vSVzs89Zxr8WDUMzZXDs8ua-qlk9qvD2rmXO7KNtdgzauS4oRpSAVkPolJiTbWfWS8AF32fMNgcDw\" alt=\"\"\/><\/figure>\n\n\n\n<p>Create a new key-value pair or select an existing one. Click on Launch instance.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh3.googleusercontent.com\/0Eh3OgYMXx8vxsomUFeSTVyY08p6R5DWi9prbde3kYzbWIf_wD8RWPMYMU1bR0rxxHDjFRfZ7p9yDwznNc7l5jiIXF98uMktW43NfPE4vIC91KiLkv3n4X0btCJjIxLBbExkdPJjUrEMaQssOIPP6A\" alt=\"How to deploy Amazon EC2 P4d instances in EC2 UltraClusters to get highest performance for ML training and HPC in the Cloud?\"\/><\/figure>\n\n\n\n<p class=\"has-text-align-justify\">In a few minutes, the instance will launch and then you can connect to it via the command line and start training your models.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh4.googleusercontent.com\/gYTyI813ZurQk2imPZWobDqAqsslXG87iDV1xYClfiooAPGkljP_cY1LUq_DpNLa98XYQYx6wTXXsEzt0GSzlfotk1CNqPP09qpC3X-zd2sktA5xC9YifL8jf-T6Fqm4bWeSktgZq5Pfxf_Kc1zXAg\" alt=\"\"\/><\/figure>\n\n\n\n<p class=\"has-text-align-justify\">To mount the file system, on the file system console, select the file system and click on Attach. You can follow the same steps to mount the file system.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img src=\"https:\/\/lh5.googleusercontent.com\/7XaGzoUArzSNtsz41RyUZcjmmJyXDQHaDGcID4M2ICSaZSxBIVGIQ3WrBA99jaA8_Avs9wFfORMqMYv5roYE4oV49PdmhC8AB7JyfWF6Pgun8sEoCv6VTqn6TeRaj4difk5PrEkj83sNmpekxsHhKA\" alt=\"How to deploy Amazon EC2 P4d instances in EC2 UltraClusters to get highest performance for ML training and HPC in the Cloud?\"\/><\/figure>\n\n\n\n<h1>Conclusion<\/h1>\n\n\n\n<p class=\"has-text-align-justify\">In this blog, we explored EC2 P4d Instances, their features, benefits, performance, and use cases. We also saw how we can launch a high-performance HPC cluster in the cloud using EC2 UltraClusters of P4d Instances. Navigating to the VPC dashboard, we first created a private subnet in a VPC. Then we navigated to the NAT Gateway dashboard and created a new NAT gateway with the private subnet attached. We then created a route table thereby editing its routing entries and the subnet associations. To access the EC2 Ultracluster, we created 2 security groups, one for EFA and the other one for external SSH. We then launched an FSx for the Lustre file system followed by launching a cluster of EC2 P4d instances with 4 EFA ENIs. Finally, we had a look at the steps of mounting the file system to the EC2 instance. We will discuss more use cases of P4d EC2 Ultracluster in our upcoming blogs. Stay tuned to keep getting all updates about our upcoming new blogs on AWS and relevant technologies.\u00a0<\/p>\n\n\n\n<p>For any further queries, feel free to post your comments, we are happy to help!<\/p>\n\n\n\n<p>Meanwhile \u2026<\/p>\n\n\n\n<p><strong>Keep Exploring -&gt; Keep Learning -&gt; Keep Mastering<\/strong><\/p>\n\n\n\n<p class=\"has-text-align-justify\">This blog is part of our effort towards building a knowledgeable and kick-ass tech community. At <a href=\"https:\/\/www.workfall.com\/\">Workfall<\/a>, we strive to provide the best tech and pay opportunities to AWS-certified talents. If you\u2019re looking to work with global clients, build kick-ass products while making big bucks doing so, give it a shot at<a href=\"https:\/\/www.workfall.com\/partner\/\"> workfall.com\/partner<\/a> today.<\/p>\n","protected":false},"excerpt":{"rendered":"<p><span class=\"rt-reading-time\" style=\"display: block;\"><span class=\"rt-label rt-prefix\">Reading Time: <\/span> <span class=\"rt-time\">11<\/span> <span class=\"rt-label rt-postfix\">minutes<\/span><\/span> Amazon EC2 P4d instances deliver the highest performance for machine learning (ML) training and high-performance computing (HPC) applications in the cloud. Amazon EC2 P4d instances are deployed in hyperscale clusters called EC2 UltraClusters that comprise the high-performance compute, networking, and storage in the cloud. Each EC2 UltraCluster of P4d instances comprises more than 4,000 of [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":280,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"spay_email":""},"categories":[2],"tags":[3,7,8,9,6],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v19.1 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>How to deploy Amazon EC2 P4d instances in EC2 UltraClusters to get highest performance for ML training and HPC in the Cloud? - The Workfall Blog<\/title>\n<meta name=\"description\" content=\"Amazon EC2 P4d instances deliver the highest performance for ML training and high-performance computing (HPC) applications in the cloud.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/learning.workfall.com\/learning\/blog\/how-to-deploy-amazon-ec2-p4d-instances-in-ec2-ultraclusters-to-get-highest-performance-for-ml-training-and-hpc-in-the-cloud\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How to deploy Amazon EC2 P4d instances in EC2 UltraClusters to get highest performance for ML training and HPC in the Cloud? - The Workfall Blog\" \/>\n<meta property=\"og:description\" content=\"Amazon EC2 P4d instances deliver the highest performance for ML training and high-performance computing (HPC) applications in the cloud.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/learning.workfall.com\/learning\/blog\/how-to-deploy-amazon-ec2-p4d-instances-in-ec2-ultraclusters-to-get-highest-performance-for-ml-training-and-hpc-in-the-cloud\/\" \/>\n<meta property=\"og:site_name\" content=\"The Workfall Blog\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/facebook.com\/workfall\" \/>\n<meta property=\"article:published_time\" content=\"2021-10-27T05:35:35+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-05-08T11:34:28+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/learning.workfall.com\/learning\/blog\/wp-content\/uploads\/2021\/10\/VPC.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"628\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@workfall\" \/>\n<meta name=\"twitter:site\" content=\"@workfall\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Workfall\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"22 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Organization\",\"@id\":\"https:\/\/learning.workfall.com\/learning\/blog\/#organization\",\"name\":\"Workfall - Hire #Kickass Coders On Demand\",\"url\":\"https:\/\/learning.workfall.com\/learning\/blog\/\",\"sameAs\":[\"https:\/\/www.instagram.com\/workfall\/\",\"https:\/\/www.linkedin.com\/company\/workfall\/\",\"https:\/\/facebook.com\/workfall\",\"https:\/\/twitter.com\/workfall\"],\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/learning.workfall.com\/learning\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/i1.wp.com\/18.141.20.153\/learning\/blog\/wp-content\/uploads\/2021\/10\/cropped-WF_logo.png?fit=400%2C400\",\"contentUrl\":\"https:\/\/i1.wp.com\/18.141.20.153\/learning\/blog\/wp-content\/uploads\/2021\/10\/cropped-WF_logo.png?fit=400%2C400\",\"width\":400,\"height\":400,\"caption\":\"Workfall - Hire #Kickass Coders On Demand\"},\"image\":{\"@id\":\"https:\/\/learning.workfall.com\/learning\/blog\/#\/schema\/logo\/image\/\"}},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/learning.workfall.com\/learning\/blog\/#website\",\"url\":\"https:\/\/learning.workfall.com\/learning\/blog\/\",\"name\":\"The Workfall Blog\",\"description\":\"#Tech #Remote #Jobs\",\"publisher\":{\"@id\":\"https:\/\/learning.workfall.com\/learning\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/learning.workfall.com\/learning\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/learning.workfall.com\/learning\/blog\/how-to-deploy-amazon-ec2-p4d-instances-in-ec2-ultraclusters-to-get-highest-performance-for-ml-training-and-hpc-in-the-cloud\/#primaryimage\",\"url\":\"https:\/\/learning.workfall.com\/learning\/blog\/wp-content\/uploads\/2021\/10\/VPC.png\",\"contentUrl\":\"https:\/\/learning.workfall.com\/learning\/blog\/wp-content\/uploads\/2021\/10\/VPC.png\",\"width\":1200,\"height\":628,\"caption\":\"EC2 UltraClusters of P4d Instances\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/learning.workfall.com\/learning\/blog\/how-to-deploy-amazon-ec2-p4d-instances-in-ec2-ultraclusters-to-get-highest-performance-for-ml-training-and-hpc-in-the-cloud\/#webpage\",\"url\":\"https:\/\/learning.workfall.com\/learning\/blog\/how-to-deploy-amazon-ec2-p4d-instances-in-ec2-ultraclusters-to-get-highest-performance-for-ml-training-and-hpc-in-the-cloud\/\",\"name\":\"How to deploy Amazon EC2 P4d instances in EC2 UltraClusters to get highest performance for ML training and HPC in the Cloud? - The Workfall Blog\",\"isPartOf\":{\"@id\":\"https:\/\/learning.workfall.com\/learning\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/learning.workfall.com\/learning\/blog\/how-to-deploy-amazon-ec2-p4d-instances-in-ec2-ultraclusters-to-get-highest-performance-for-ml-training-and-hpc-in-the-cloud\/#primaryimage\"},\"datePublished\":\"2021-10-27T05:35:35+00:00\",\"dateModified\":\"2023-05-08T11:34:28+00:00\",\"description\":\"Amazon EC2 P4d instances deliver the highest performance for ML training and high-performance computing (HPC) applications in the cloud.\",\"breadcrumb\":{\"@id\":\"https:\/\/learning.workfall.com\/learning\/blog\/how-to-deploy-amazon-ec2-p4d-instances-in-ec2-ultraclusters-to-get-highest-performance-for-ml-training-and-hpc-in-the-cloud\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/learning.workfall.com\/learning\/blog\/how-to-deploy-amazon-ec2-p4d-instances-in-ec2-ultraclusters-to-get-highest-performance-for-ml-training-and-hpc-in-the-cloud\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/learning.workfall.com\/learning\/blog\/how-to-deploy-amazon-ec2-p4d-instances-in-ec2-ultraclusters-to-get-highest-performance-for-ml-training-and-hpc-in-the-cloud\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/learning.workfall.com\/learning\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"How to deploy Amazon EC2 P4d instances in EC2 UltraClusters to get highest performance for ML training and HPC in the Cloud?\"}]},{\"@type\":\"Article\",\"@id\":\"https:\/\/learning.workfall.com\/learning\/blog\/how-to-deploy-amazon-ec2-p4d-instances-in-ec2-ultraclusters-to-get-highest-performance-for-ml-training-and-hpc-in-the-cloud\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/learning.workfall.com\/learning\/blog\/how-to-deploy-amazon-ec2-p4d-instances-in-ec2-ultraclusters-to-get-highest-performance-for-ml-training-and-hpc-in-the-cloud\/#webpage\"},\"author\":{\"@id\":\"https:\/\/learning.workfall.com\/learning\/blog\/#\/schema\/person\/cab8236044692bc5b27606b13167794a\"},\"headline\":\"How to deploy Amazon EC2 P4d instances in EC2 UltraClusters to get highest performance for ML training and HPC in the Cloud?\",\"datePublished\":\"2021-10-27T05:35:35+00:00\",\"dateModified\":\"2023-05-08T11:34:28+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/learning.workfall.com\/learning\/blog\/how-to-deploy-amazon-ec2-p4d-instances-in-ec2-ultraclusters-to-get-highest-performance-for-ml-training-and-hpc-in-the-cloud\/#webpage\"},\"wordCount\":2170,\"publisher\":{\"@id\":\"https:\/\/learning.workfall.com\/learning\/blog\/#organization\"},\"image\":{\"@id\":\"https:\/\/learning.workfall.com\/learning\/blog\/how-to-deploy-amazon-ec2-p4d-instances-in-ec2-ultraclusters-to-get-highest-performance-for-ml-training-and-hpc-in-the-cloud\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/learning.workfall.com\/learning\/blog\/wp-content\/uploads\/2021\/10\/VPC.png\",\"keywords\":[\"AWS\",\"AWS EC2\",\"p4d instances\",\"ultracluster\",\"workfall\"],\"articleSection\":[\"AWS Cloud Computing\"],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/learning.workfall.com\/learning\/blog\/#\/schema\/person\/cab8236044692bc5b27606b13167794a\",\"name\":\"Workfall\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/learning.workfall.com\/learning\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/learning.workfall.com\/learning\/blog\/wp-content\/uploads\/2023\/09\/avatar_user_1_1693914404-96x96.png\",\"contentUrl\":\"https:\/\/learning.workfall.com\/learning\/blog\/wp-content\/uploads\/2023\/09\/avatar_user_1_1693914404-96x96.png\",\"caption\":\"Workfall\"},\"sameAs\":[\"https:\/\/www.workfall.com\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"How to deploy Amazon EC2 P4d instances in EC2 UltraClusters to get highest performance for ML training and HPC in the Cloud? - The Workfall Blog","description":"Amazon EC2 P4d instances deliver the highest performance for ML training and high-performance computing (HPC) applications in the cloud.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/learning.workfall.com\/learning\/blog\/how-to-deploy-amazon-ec2-p4d-instances-in-ec2-ultraclusters-to-get-highest-performance-for-ml-training-and-hpc-in-the-cloud\/","og_locale":"en_US","og_type":"article","og_title":"How to deploy Amazon EC2 P4d instances in EC2 UltraClusters to get highest performance for ML training and HPC in the Cloud? - The Workfall Blog","og_description":"Amazon EC2 P4d instances deliver the highest performance for ML training and high-performance computing (HPC) applications in the cloud.","og_url":"https:\/\/learning.workfall.com\/learning\/blog\/how-to-deploy-amazon-ec2-p4d-instances-in-ec2-ultraclusters-to-get-highest-performance-for-ml-training-and-hpc-in-the-cloud\/","og_site_name":"The Workfall Blog","article_publisher":"https:\/\/facebook.com\/workfall","article_published_time":"2021-10-27T05:35:35+00:00","article_modified_time":"2023-05-08T11:34:28+00:00","og_image":[{"width":1200,"height":628,"url":"https:\/\/learning.workfall.com\/learning\/blog\/wp-content\/uploads\/2021\/10\/VPC.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_creator":"@workfall","twitter_site":"@workfall","twitter_misc":{"Written by":"Workfall","Est. reading time":"22 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Organization","@id":"https:\/\/learning.workfall.com\/learning\/blog\/#organization","name":"Workfall - Hire #Kickass Coders On Demand","url":"https:\/\/learning.workfall.com\/learning\/blog\/","sameAs":["https:\/\/www.instagram.com\/workfall\/","https:\/\/www.linkedin.com\/company\/workfall\/","https:\/\/facebook.com\/workfall","https:\/\/twitter.com\/workfall"],"logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/learning.workfall.com\/learning\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/i1.wp.com\/18.141.20.153\/learning\/blog\/wp-content\/uploads\/2021\/10\/cropped-WF_logo.png?fit=400%2C400","contentUrl":"https:\/\/i1.wp.com\/18.141.20.153\/learning\/blog\/wp-content\/uploads\/2021\/10\/cropped-WF_logo.png?fit=400%2C400","width":400,"height":400,"caption":"Workfall - Hire #Kickass Coders On Demand"},"image":{"@id":"https:\/\/learning.workfall.com\/learning\/blog\/#\/schema\/logo\/image\/"}},{"@type":"WebSite","@id":"https:\/\/learning.workfall.com\/learning\/blog\/#website","url":"https:\/\/learning.workfall.com\/learning\/blog\/","name":"The Workfall Blog","description":"#Tech #Remote #Jobs","publisher":{"@id":"https:\/\/learning.workfall.com\/learning\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/learning.workfall.com\/learning\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/learning.workfall.com\/learning\/blog\/how-to-deploy-amazon-ec2-p4d-instances-in-ec2-ultraclusters-to-get-highest-performance-for-ml-training-and-hpc-in-the-cloud\/#primaryimage","url":"https:\/\/learning.workfall.com\/learning\/blog\/wp-content\/uploads\/2021\/10\/VPC.png","contentUrl":"https:\/\/learning.workfall.com\/learning\/blog\/wp-content\/uploads\/2021\/10\/VPC.png","width":1200,"height":628,"caption":"EC2 UltraClusters of P4d Instances"},{"@type":"WebPage","@id":"https:\/\/learning.workfall.com\/learning\/blog\/how-to-deploy-amazon-ec2-p4d-instances-in-ec2-ultraclusters-to-get-highest-performance-for-ml-training-and-hpc-in-the-cloud\/#webpage","url":"https:\/\/learning.workfall.com\/learning\/blog\/how-to-deploy-amazon-ec2-p4d-instances-in-ec2-ultraclusters-to-get-highest-performance-for-ml-training-and-hpc-in-the-cloud\/","name":"How to deploy Amazon EC2 P4d instances in EC2 UltraClusters to get highest performance for ML training and HPC in the Cloud? - The Workfall Blog","isPartOf":{"@id":"https:\/\/learning.workfall.com\/learning\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/learning.workfall.com\/learning\/blog\/how-to-deploy-amazon-ec2-p4d-instances-in-ec2-ultraclusters-to-get-highest-performance-for-ml-training-and-hpc-in-the-cloud\/#primaryimage"},"datePublished":"2021-10-27T05:35:35+00:00","dateModified":"2023-05-08T11:34:28+00:00","description":"Amazon EC2 P4d instances deliver the highest performance for ML training and high-performance computing (HPC) applications in the cloud.","breadcrumb":{"@id":"https:\/\/learning.workfall.com\/learning\/blog\/how-to-deploy-amazon-ec2-p4d-instances-in-ec2-ultraclusters-to-get-highest-performance-for-ml-training-and-hpc-in-the-cloud\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/learning.workfall.com\/learning\/blog\/how-to-deploy-amazon-ec2-p4d-instances-in-ec2-ultraclusters-to-get-highest-performance-for-ml-training-and-hpc-in-the-cloud\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/learning.workfall.com\/learning\/blog\/how-to-deploy-amazon-ec2-p4d-instances-in-ec2-ultraclusters-to-get-highest-performance-for-ml-training-and-hpc-in-the-cloud\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/learning.workfall.com\/learning\/blog\/"},{"@type":"ListItem","position":2,"name":"How to deploy Amazon EC2 P4d instances in EC2 UltraClusters to get highest performance for ML training and HPC in the Cloud?"}]},{"@type":"Article","@id":"https:\/\/learning.workfall.com\/learning\/blog\/how-to-deploy-amazon-ec2-p4d-instances-in-ec2-ultraclusters-to-get-highest-performance-for-ml-training-and-hpc-in-the-cloud\/#article","isPartOf":{"@id":"https:\/\/learning.workfall.com\/learning\/blog\/how-to-deploy-amazon-ec2-p4d-instances-in-ec2-ultraclusters-to-get-highest-performance-for-ml-training-and-hpc-in-the-cloud\/#webpage"},"author":{"@id":"https:\/\/learning.workfall.com\/learning\/blog\/#\/schema\/person\/cab8236044692bc5b27606b13167794a"},"headline":"How to deploy Amazon EC2 P4d instances in EC2 UltraClusters to get highest performance for ML training and HPC in the Cloud?","datePublished":"2021-10-27T05:35:35+00:00","dateModified":"2023-05-08T11:34:28+00:00","mainEntityOfPage":{"@id":"https:\/\/learning.workfall.com\/learning\/blog\/how-to-deploy-amazon-ec2-p4d-instances-in-ec2-ultraclusters-to-get-highest-performance-for-ml-training-and-hpc-in-the-cloud\/#webpage"},"wordCount":2170,"publisher":{"@id":"https:\/\/learning.workfall.com\/learning\/blog\/#organization"},"image":{"@id":"https:\/\/learning.workfall.com\/learning\/blog\/how-to-deploy-amazon-ec2-p4d-instances-in-ec2-ultraclusters-to-get-highest-performance-for-ml-training-and-hpc-in-the-cloud\/#primaryimage"},"thumbnailUrl":"https:\/\/learning.workfall.com\/learning\/blog\/wp-content\/uploads\/2021\/10\/VPC.png","keywords":["AWS","AWS EC2","p4d instances","ultracluster","workfall"],"articleSection":["AWS Cloud Computing"],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/learning.workfall.com\/learning\/blog\/#\/schema\/person\/cab8236044692bc5b27606b13167794a","name":"Workfall","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/learning.workfall.com\/learning\/blog\/#\/schema\/person\/image\/","url":"https:\/\/learning.workfall.com\/learning\/blog\/wp-content\/uploads\/2023\/09\/avatar_user_1_1693914404-96x96.png","contentUrl":"https:\/\/learning.workfall.com\/learning\/blog\/wp-content\/uploads\/2023\/09\/avatar_user_1_1693914404-96x96.png","caption":"Workfall"},"sameAs":["https:\/\/www.workfall.com"]}]}},"jetpack_featured_media_url":"https:\/\/learning.workfall.com\/learning\/blog\/wp-content\/uploads\/2021\/10\/VPC.png","jetpack-related-posts":[{"id":467,"url":"https:\/\/learning.workfall.com\/learning\/blog\/15-awsome-years-of-amazon-ec2-and-still-going-strong\/","url_meta":{"origin":164,"position":0},"title":"15 AWSome years of Amazon EC2 and still going strong!","date":"November 9, 2021","format":false,"excerpt":"This year marks the 15th anniversary of Amazon EC2(Amazon Elastic Compute Cloud), marking a landmark milestone for both the firm and the computing industry it serves. The EC2 instance is at the heart of the AWS cloud platform, allowing users to rent storage, network connectivity, and computation resources. It's difficult\u2026","rel":"","context":"In &quot;AWS Cloud Computing&quot;","img":{"alt_text":"AWSome 15 Years of Amazon EC2","src":"https:\/\/i1.wp.com\/learning.workfall.com\/learning\/blog\/wp-content\/uploads\/2021\/11\/ec2_15yrs.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":621,"url":"https:\/\/learning.workfall.com\/learning\/blog\/how-to-run-fault-tolerant-workloads-for-up-to-90-off-using-amazon-ec2-spot-instances\/","url_meta":{"origin":164,"position":1},"title":"How to run fault-tolerant workloads for up to 90% off using Amazon EC2 Spot Instances?","date":"November 11, 2021","format":false,"excerpt":"Understanding cloud bills and how to get the most out of the budget on AWS is becoming increasingly important as enterprises migrate more applications and services to the cloud and a larger portion of IT budgets is diverted to cloud providers. With specialized tools, economic models, and best practices, AWS\u2026","rel":"","context":"In &quot;AWS Cloud Computing&quot;","img":{"alt_text":"Cost Optimization with EC2 Spot Instances","src":"https:\/\/i2.wp.com\/learning.workfall.com\/learning\/blog\/wp-content\/uploads\/2021\/11\/spot.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":651,"url":"https:\/\/learning.workfall.com\/learning\/blog\/how-to-launch-ec2-spot-instances-using-amazon-ec2-auto-scaling-and-aws-application-load-balancer-part-2\/","url_meta":{"origin":164,"position":2},"title":"How to launch EC2 Spot Instances using Amazon EC2 Auto Scaling and AWS Application Load Balancer (Part 2)?","date":"November 11, 2021","format":false,"excerpt":"A Spot Instance is a virtual machine that runs on spare EC2 capacity that is offered at a lower price than the On-Demand price. Spot Instances allow you to request unused EC2 instances at great discounts, allowing you to dramatically reduce your Amazon EC2 expenditures. A Spot Instance's hourly pricing\u2026","rel":"","context":"In &quot;AWS Cloud Computing&quot;","img":{"alt_text":"Launch EC2 Spot Instances - AWS","src":"https:\/\/i2.wp.com\/learning.workfall.com\/learning\/blog\/wp-content\/uploads\/2021\/11\/CoverImages_1200x628px-2-1.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":215,"url":"https:\/\/learning.workfall.com\/learning\/blog\/how-to-install-and-run-docker-containers-on-amazon-ec2-instance\/","url_meta":{"origin":164,"position":3},"title":"How to install and run Docker Containers on Amazon EC2 Instance?","date":"October 27, 2021","format":false,"excerpt":"While running Docker on AWS, developers and admins can build, ship, and run highly reliable distributed applications at any scale.\u00a0\u00a0In this blog, we will demonstrate how to install, build and run docker containers on Amazon EC2 instances. Refer to Part 1 of the blog here: How To Install And Run\u2026","rel":"","context":"In &quot;AWS Cloud Computing&quot;","img":{"alt_text":"Insrall and Run Docker on Amazon EC2 - Workfall","src":"https:\/\/i1.wp.com\/learning.workfall.com\/learning\/blog\/wp-content\/uploads\/2021\/10\/docker.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":125,"url":"https:\/\/learning.workfall.com\/learning\/blog\/how-to-train-a-deep-learning-model-with-aws-deep-learning-containers-on-amazon-ec2\/","url_meta":{"origin":164,"position":4},"title":"How to train a Deep Learning model with AWS Deep Learning Containers on Amazon EC2?","date":"October 26, 2021","format":false,"excerpt":"Data scientists, machine learning engineers, and practitioners must devote significant time and resources to developing, testing, updating, and optimizing Docker images for deep learning. Instead of concentrating on developing and enhancing models, practitioners are forced to divert valuable resources to unrelated tasks. Installing packages, resolving compatibility concerns, performance optimization, and\u2026","rel":"","context":"In &quot;AWS Cloud Computing&quot;","img":{"alt_text":"Train a Deep Learning model with AWS Deep Learning Containers on Amazon EC2","src":"https:\/\/i2.wp.com\/learning.workfall.com\/learning\/blog\/wp-content\/uploads\/2021\/10\/CoverImages_1200x628px-2.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":399,"url":"https:\/\/learning.workfall.com\/learning\/blog\/how-to-create-and-mount-an-amazon-efs-file-system-using-amazon-ec2-launch-instance-wizard\/","url_meta":{"origin":164,"position":5},"title":"How to create and mount an Amazon EFS file system using Amazon EC2 Launch Instance Wizard?","date":"November 3, 2021","format":false,"excerpt":"Sizing, configuring, and deploying AWS resources for third-party applications, such as SAP or SQL server is always challenging for you. Are you looking for a wizard who can help you with these challenging tasks?\u00a0 AWS Launch Wizard can help you in simplifying these tasks by offering a guided way of\u2026","rel":"","context":"In &quot;AWS Cloud Computing&quot;","img":{"alt_text":"How to create and mount an Amazon EFS file system using Amazon EC2 Launch Instance Wizard","src":"https:\/\/i2.wp.com\/learning.workfall.com\/learning\/blog\/wp-content\/uploads\/2021\/11\/Launch-Wizard.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]}],"_links":{"self":[{"href":"https:\/\/learning.workfall.com\/learning\/blog\/wp-json\/wp\/v2\/posts\/164"}],"collection":[{"href":"https:\/\/learning.workfall.com\/learning\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/learning.workfall.com\/learning\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/learning.workfall.com\/learning\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/learning.workfall.com\/learning\/blog\/wp-json\/wp\/v2\/comments?post=164"}],"version-history":[{"count":12,"href":"https:\/\/learning.workfall.com\/learning\/blog\/wp-json\/wp\/v2\/posts\/164\/revisions"}],"predecessor-version":[{"id":2257,"href":"https:\/\/learning.workfall.com\/learning\/blog\/wp-json\/wp\/v2\/posts\/164\/revisions\/2257"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/learning.workfall.com\/learning\/blog\/wp-json\/wp\/v2\/media\/280"}],"wp:attachment":[{"href":"https:\/\/learning.workfall.com\/learning\/blog\/wp-json\/wp\/v2\/media?parent=164"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/learning.workfall.com\/learning\/blog\/wp-json\/wp\/v2\/categories?post=164"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/learning.workfall.com\/learning\/blog\/wp-json\/wp\/v2\/tags?post=164"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}