The Story of Data using Secure Analytics

story-of-data

Datafence provides a range of Analytics Consulting Services including Data Engineering and Data Science seamlessly aligned with you business needs and in compliance with government and industry regulations. We work with your team to architect, develop and implement the next generation analytics platforms.

Our services include:

  • Developing a data strategy and road-map
  • Architecting the next generation analytics platform using Lambda architecture
  • Designing massive parallel processing (MPP) architectures
  • Shortlisting the optimal virtual or cloud platform for Big Data platforms
  • Data Warehouse and Data Lake Development
  • Automation of data analytics pipelines
  • Outsourced Data Analytics

Our Data Engineers have several years of experience dealing with large volumes of data for distributed storage and processing. Our Data Engineers are experts at the following technologies:

  • Hadoop Eco-system including HDFS, Mapreduce, Sqoop, Hive, Oozie and HBase - Cloudera and Hortonworks
  • Azure HDInsight, Azure Storage, Azure Data Lakes and Azure Data Warehouse
  • Google Storage, Google Bigquery and Google BigTable
  • AWS, Amazon S3, Amazon Redshift, Amazon Kinesis
  • IoT data collection using Apache NiFi
  • Creation of Spark jobs for data analysis using Python - Batch and Streaming
  • Data orchestration using Airflow and Oozie
  • Steam Analytics using Kafka and Spark Streaming
  • Configuring Hadoop Security - Cloudera Navigator, Kerberos , Encryption and Sentry
  • Hadoop Benchmarking
  • Automated Hadoop and Spark cluster provisioning

 

Facebook
Twitter
LinkedIn
SOCIALICON