Big Data Developer with Azure Cloud

Posted: 3 months ago

  • Strong Experience with Hadoop distributions HDInsight and associated Tech Stack like ADLS, Kafka, Sqoop, Hive, Spark Microsoft Azure Cloud development, Cloud Computing, Powershell, Azure CLI, Python, REST API.
  • Strong experience of the UNIX environment and scripting
  • Equip applications with advanced search features by leveraging Azure Search.
  • Create an Azure Search service, query an index, score profiles and sync data stores, scale for more QPS and high availability, scale for more documents and higher write throughput, and tighten security via CORS.
  • Strong Experience with NoSQL databases, such as HBase, CosmosDB Manage Big Data with ADLS using Azure Storage Explorer, Putty and various ways of loading the data for HDInsight.
  • Automate Microsoft HDInsight Big Data jobs using Powershell.
  • Support and build Spark Machine Learning in Spark cluster in HDInsight Support artificial intelligence AI solutions with Azure Databricks.
  • Create container images from an application, Upload container images to the Azure Container Registry, Deploy an AKS cluster, Run container images in Kubernetes
  • Some experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming
  • Experience with integration of data from multiple data sources
  • Experience of software development using Python or R
  • Familiarity with common web application components such as Apache Web Server and Apache Tomcat or similar technologies