Senior Big Data Engineer

CBTS serves enterprise and midmarket clients in all industries across the United States and Canada. CBTS combines deep technical expertise with a full suite of flexible technology solutions--including Application Modernization, Managed Hybrid Cloud, Cybersecurity, Unified Communications, and Infrastructure solutions. From developing and deploying modern applications and the secure, scalable platforms on which they run, to managing, monitoring, and optimizing their operations, CBTS delivers comprehensive technology solutions for its clients' transformative business initiatives. For more information, please visit http://www.cbts.com. OnX is a leading technology solution provider that serves businesses, healthcare organizations, and government agencies across Canada. OnX combines deep technical expertise with a full suite of flexible technology solutions—including Generative AI, Application Modernization, Managed Hybrid Cloud, Cybersecurity, Unified Communications, and Infrastructure solutions. From developing and deploying modern applications and the secure, scalable platforms on which they run, to managing, monitoring, and optimizing their operations, OnX delivers comprehensive technology solutions for its clients’ transformative business initiatives. For more information, please visit http://www.onx.com. Job Summary We are seeking a Senior Big Data Engineer to design, build, and optimize large‑scale data processing systems that power analytics, reporting, and data‑driven decision‑making. The ideal candidate has deep expertise in distributed data systems, cloud platforms, and modern data engineering practices, and can mentor junior engineers while collaborating closely with data scientists, analysts, and product teams. Key Responsibilities Design, develop, and maintain scalable, high‑performance big data pipelines for batch and real‑time processingBuild and optimize data ingestion, transformation, and storage solutions handling structured and unstructured dataWork with large datasets using distributed computing frameworks such as Apache Spark, Hadoop, Flink, or similarDevelop robust ETL/ELT workflows with strong data quality, reliability, and monitoringArchitect and manage data solutions on cloud platforms (Azure / AWS / GCP)Implement data modeling, partitioning, and performance tuning strategiesEnsure data security, compliance, and governance best practicesCollaborate with data scientists, analytics teams, and business stakeholders to enable advanced analytics and ML use casesLead technical design discussions and mentor junior and mid‑level engineersParticipate in code reviews and promote engineering best practices Required Qualifications Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field6+ years of experience in data engineering or big data developmentStrong programming skills in Python, Scala, or JavaHands‑on experience with Spark (core, SQL, streaming) and distributed data processingExperience with data storage technologies (HDFS, Delta Lake, Iceberg, HBase, Cassandra, or similar)Solid understanding of SQL and NoSQL databasesExperience building pipelines using Airflow, Azure Data Factory, or similar orchestration toolsStrong knowledge of cloud data services (e.g., Azure Data Lake, Synapse, AWS S3/EMR, BigQuery)Familiarity with CI/CD, version control (Git), and DevOps practicesExcellent problem‑solving and communication skills Preferred / Nice‑to‑Have Skills Experience with real‑time streaming platforms (Kafka, Event Hubs, Kinesis)Knowledge of data warehousing concepts and dimensional modelingExposure to machine learning data pipelinesExperience with containerization (Docker, Kubernetes)Understanding of data governance, lineage, and metadata toolsPrior experience leading or owning end‑to‑end data platforms Locations: Chennai, India