PageRenderTime 41ms CodeModel.GetById 17ms RepoModel.GetById 0ms app.codeStats 0ms

/articles/batch/big-compute-resources.md

https://gitlab.com/yeah568/azure-content
Markdown | 159 lines | 84 code | 75 blank | 0 comment | 0 complexity | 9e0e85d1a1da1b232e17ce6ffa679882 MD5 | raw file
  1. <properties
  2. pageTitle="Resources for batch and HPC workloads in the cloud | Microsoft Azure"
  3. description="Lists technical resources to help you run your large-scale parallel, batch, and high performance computing (HPC) workloads in Azure."
  4. services="batch, cloud-services, virtual-machines"
  5. documentationCenter=""
  6. authors="dlepow"
  7. manager="timlt"
  8. editor=""/>
  9. <tags
  10. ms.service="multiple"
  11. ms.devlang="multiple"
  12. ms.topic="article"
  13. ms.tgt_pltfrm="NA"
  14. ms.workload="big-compute"
  15. ms.date="06/08/2016"
  16. ms.author="danlep"/>
  17. # Big Compute in Azure: Technical resources for batch and high performance computing (HPC)
  18. This is a guide to technical resources to help you run your large-scale parallel, batch, and HPC workloads in Azure. Extend your existing batch or HPC workloads to the Azure cloud, or build new Big Compute solutions in Azure using a range of Azure services.
  19. ## Solutions options
  20. Learn about Big Compute options in Azure, and choose the right approach for your workload and business need.
  21. * [Batch and HPC solutions](batch-hpc-solutions.md)
  22. * [Video: Big Compute in the cloud with Azure and HPC](https://azure.microsoft.com/documentation/videos/teched-europe-2014-big-compute-in-the-cloud-with-high-performance-computing-on-azure/)
  23. ## Azure Batch
  24. [Batch](https://azure.microsoft.com/services/batch/) is a platform service that makes it easy to cloud-enable your Linux and Windows applications and run jobs without setting up and managing a cluster and job scheduler. Use the SDK to integrate client applications with Azure Batch through a variety of languages, stage data to Azure, and build job execution pipelines.
  25. * [Documentation](https://azure.microsoft.com/documentation/services/batch/)
  26. * [.NET](https://msdn.microsoft.com/library/azure/mt348682.aspx), [Python](http://azure-sdk-for-python.readthedocs.io/latest/), [Node.js](http://azure.github.io/azure-sdk-for-node/azure-batch/latest/), [Java](http://azure.github.io/azure-sdk-for-java/), and [REST](https://msdn.microsoft.com/library/azure/dn820158.aspx) API reference
  27. * [Batch management .NET library](https://msdn.microsoft.com/library/mt463120.aspx) reference
  28. * Tutorials: Get started with [Azure Batch library for .NET](batch-dotnet-get-started.md) and [Batch Python client](batch-python-tutorial.md)
  29. * [Batch forum](https://social.msdn.microsoft.com/Forums/en-US/home?forum=azurebatch)
  30. * [Batch videos](https://azure.microsoft.com/documentation/videos/index/?services=batch)
  31. ## HPC cluster solutions
  32. Deploy or extend your existing Windows or Linux HPC cluster to Azure to run your compute intensive workloads.
  33. ### Microsoft HPC Pack
  34. HPC Pack is Microsoft's free HPC solution built on Microsoft Azure and Windows Server technologies, capable of running Windows and Linux HPC workloads.
  35. * [Download HPC Pack 2012 R2 Update 3](https://www.microsoft.com/download/details.aspx?id=49922)
  36. * [Documentation](https://technet.microsoft.com/library/jj899572.aspx)
  37. * [Linux](../virtual-machines/virtual-machines-linux-hpcpack-cluster-options.md) and [Windows](../virtual-machines/virtual-machines-windows-hpcpack-cluster-options.md) HPC Pack cluster options in Azure
  38. * [Burst to Azure worker instances with HPC Pack](https://technet.microsoft.com/library/gg481749.aspx)
  39. * [Burst to Azure Batch with HPC Pack](https://technet.microsoft.com/library/mt612877.aspx)
  40. * [Windows HPC forums](https://social.microsoft.com/Forums/home?category=windowshpc)
  41. ### Linux and OSS cluster solutions
  42. Use these Azure templates to deploy Linux HPC clusters.
  43. * [Spin up a SLURM cluster](https://azure.microsoft.com/documentation/templates/slurm/)
  44. and [blog post](http://blogs.technet.com/b/windowshpc/archive/2015/06/06/deploy-a-slurm-cluster-on-azure.aspx)
  45. * [Spin up a Torque cluster](https://azure.microsoft.com/documentation/templates/torque-cluster/)
  46. * [Intel Cloud Edition for Lustre Software - Eval](https://azure.microsoft.com/marketplace/partners/intel/lustre-cloud-edition-evaleval-lustre-2-7/)
  47. ## Microsoft MPI
  48. [Microsoft MPI](https://msdn.microsoft.com/library/bb524831.aspx) (MS-MPI) is a Microsoft implementation of the Message Passing Interface standard for developing and running parallel applications on the Windows platform. The latest version is MS-MPI v7.
  49. * [Download MS-MPI](http://go.microsoft.com/FWLink/p/?LinkID=389556)
  50. * [MS-MPI reference](https://msdn.microsoft.com/library/dn473458.aspx)
  51. * [MPI forum](https://social.microsoft.com/Forums/en-us/home?forum=windowshpcmpi)
  52. ## Compute intensive instances
  53. Azure offers a [range of sizes](../virtual-machines/virtual-machines-windows-sizes.md), including compute intensive [A8 and A9](../virtual-machines/virtual-machines-windows-a8-a9-a10-a11-specs.md) instances capable of connecting to a back-end RDMA network, to run your Linux and Windows HPC workloads.
  54. * [Set up a Linux RDMA cluster to run MPI applications](../virtual-machines/virtual-machines-linux-classic-rdma-cluster.md)
  55. * [Set up a Windows RDMA cluster with Microsoft HPC Pack to run MPI applications](../virtual-machines/virtual-machines-windows-classic-hpcpack-rdma-cluster.md)
  56. ## Samples and demos
  57. * [Azure Batch C# and Python code samples](https://github.com/Azure/azure-batch-samples)
  58. * [Test drive SUSE Linux Enterprise Server for HPC](https://azure.microsoft.com/marketplace/partners/suse/suselinuxenterpriseserver12optimizedforhighperformancecompute/)
  59. ## Related Azure services
  60. * [Data Factory](https://azure.microsoft.com/documentation/services/data-factory/)
  61. * [Machine Learning](https://azure.microsoft.com/documentation/services/machine-learning/)
  62. * [HDInsight](https://azure.microsoft.com/documentation/services/hdinsight/)
  63. * [Virtual Machines](https://azure.microsoft.com/documentation/services/virtual-machines/)
  64. * [Virtual Machine Scale Sets](https://azure.microsoft.com/documentation/services/virtual-machine-scale-sets/)
  65. * [Cloud Services](https://azure.microsoft.com/documentation/services/cloud-services/)
  66. * [Media Services](https://azure.microsoft.com/documentation/services/media-services/)
  67. ## Architecture blueprints
  68. * [HPC and data orchestration using Azure Batch and Azure Data Factory](http://go.microsoft.com/fwlink/?linkid=717686) (PDF) and [article](../data-factory/data-factory-data-processing-using-batch.md)
  69. ## Industry solutions
  70. * [Banking and capital markets](https://finance.azure.com/)
  71. * [Engineering simulations](https://simulation.azure.com/)
  72. ## Customer stories
  73. * [ANEO](https://customers.microsoft.com/Pages/CustomerStory.aspx?recid=4168)
  74. * [d3View](https://customers.microsoft.com/Pages/CustomerStory.aspx?recid=22088)
  75. * [Ludwig Institute of Cancer Research](https://customers.microsoft.com/Pages/CustomerStory.aspx?recid=5830)
  76. * [Microsoft Research](https://customers.microsoft.com/Pages/CustomerStory.aspx?recid=15634)
  77. * [Milliman](https://customers.microsoft.com/Pages/CustomerStory.aspx?recid=14967)
  78. * [Mitsubishi UFJ Securities International](https://customers.microsoft.com/Pages/CustomerStory.aspx?recid=26266)
  79. * [Schlumberger](http://azure.microsoft.com/blog/big-compute-for-large-engineering-simulations)
  80. * [Towers Watson](https://customers.microsoft.com/Pages/CustomerStory.aspx?recid=18222)
  81. * [UberCloud](https://simulation.azure.com/casestudies/Team-182-ABB-UC-Final.pdf)
  82. ## Next steps
  83. * For the latest announcements, see the [Microsoft HPC and Batch team blog](http://blogs.technet.com/b/windowshpc/) and the [Azure blog](https://azure.microsoft.com/blog/tag/hpc/).
  84. * Also see [what's new in Batch](https://azure.microsoft.com/updates/?service=batch) or subscribe to the [RSS feed](https://azure.microsoft.com/updates/feed/?service=batch).