Data Architect & Senior Data Engineer

Maitree Manna designs
data platforms that scale.

13+ years across BFSI and Retail — designing metadata-driven ingestion frameworks, migrating legacy systems to the cloud, and building the Big Data practice at Capgemini. Deep in Hadoop, Spark, Flink, Kafka, AWS, and Azure.

01 — About

Professional Summary

13+ years of progressive IT experience across the BFSI and Retail domains, spanning key roles as Data Architect, Senior Data Engineer, and Techno-Functional SME.

RFP & Solution Architecture

Authored winning RFP responses as Bigdata Architect and delivered enterprise-scale platforms as Solution Architect.

Big Data Ecosystem

Deep hands-on expertise across HDFS, Hive, Impala, Sqoop, NiFi, Flink, PySpark, and Kafka.

Multi-Cloud, AWS & Azure

Strong command of both platforms, backed by solid data warehouse design, SQL-driven analysis, and Python.

Cross-Geo Delivery

Partnering with stakeholders and delivery teams across multiple geographies on Hadoop ecosystem solutions.

Full Lifecycle Ownership

End-to-end ownership — ideation, analysis, design, architecture, development, testing, deployment.

CI/CD Automation

Building and maintaining CI/CD pipelines to streamline and automate delivery.

13+ Years in IT
4 Enterprise employers
2 Cloud platforms (AWS / Azure)
4 Certifications

02 — Skills

Technical Toolkit

Environment

Hortonworks Distribution Cloudera

Big Data Ecosystem

HadoopHDFSHive ImpalaSqoopNiFi Flink / PyFlinkPySpark KafkaHBase

AWS

RedshiftEMRS3 GlueAthenaLambda RDSDynamoDBSNSSQS

Azure

DatabricksData Factory

Languages

SQLPythonUnix Shell Script

SQL / NoSQL Databases

OraclePostgresMySQL MS SQL ServerMongoDB

CI/CD & Scheduling

GitHubJenkinsAirflow OozieAutosysBMC

BI / Visualization

Tableau

AI Tools

Claude (Anthropic)

03 — Journey

Know My Career Journey

CG

Data Architect & Sr Data Engineer · Capgemini India Pvt. Ltd.

Apr 2024 – Present

Hyderabad, India

Global Insurer Apr 2024 – Present

  • Designed a multi-entity, multi-region lakehouse on Databricks on AWS, keeping each entity's data in its approved region to meet GDPR, local data-protection and data-residency rules.
  • Architected a fully metadata-driven ingestion framework: one generic PySpark job reads source and table configuration (keys, load type, SCD type, PII columns), so new sources are onboarded through config, not new code.
  • Built medallion pipelines (bronze → silver → gold) with Delta Lake and Auto Loader, including Delta MERGE upserts and SCD Type 2 history for Party, Contract and Claims data.
  • Defined personal-data governance in Unity Catalog: PII classification tags, column masks, row filters, group-based grants and lineage for audit.
  • Built real-time stream processing with Kafka and PyFlink on EKS, with MongoDB as the operational store and S3 checkpointing for fault-tolerant, replayable processing.
  • Set up CI/CD with Jenkins, GitHub and Databricks Asset Bundles across dev, test and prod, and kept production costs in check with job clusters, autoscaling, Photon and Delta table maintenance.
DatabricksDelta LakeUnity Catalog PySparkKafkaPyFlink MongoDBEKSJenkins

Big Data Practice Leadership Apr 2024 – Present

  • Contribute to and manage the Big Data practice in India: analysing demand-fulfilment gaps, forecasting demand and keeping resource utilisation (ARVE) above 90%.
  • Partner with recruiters and interview panels on selecting the right people, and run day-to-day resourcing, reskilling, training and project readiness.
  • Work with the presales team on proposal management and estimation, preparing RFP/RFI responses and solution architectures.
CTS

Data Architect & Sr Data Engineer · Cognizant Technology Solutions

Jun 2022 – Apr 2024

Mumbai, India

Global Sportswear Retailer Jun 2022 – Sep 2023

  • Re-platformed the architecture by sunsetting legacy SQL Server and migrating all data to Snowflake on AWS, with Databricks as the processing layer.
  • Built PySpark ETL pipelines on Databricks to ingest data from mainframe, SQL Server and AWS sources, staging it as Delta tables on S3 and loading Snowflake through the Spark–Snowflake connector.
  • Designed historical and incremental loads using watermark/CDC columns and Delta MERGE, with re-runnable, idempotent jobs and source-to-target reconciliation before each cutover.
  • Created the logical and physical data models for the data warehouse (3NF, SCD1 and SCD2 in Snowflake), orchestrated jobs with Airflow, and led team planning and code reviews.
DatabricksDelta LakeSnowflake PySparkAirflowAWS S3

US Healthcare Provider Sep 2023 – Apr 2024

  • Built ETL pipelines taking new sources from a landing area into the raw zone of the data lake, then transforming and loading them into AWS Glue and RDS Postgres tables for Customer, Blood work, Claims and Insurance data.
  • Created views and materialized views in Redshift, and designed historical and incremental loads scheduled in BMC.
  • Guided the team through development and deployment as Sr Data Engineer.
EMRAWS GluePySpark HiveRedshiftRDS Postgres
JPM

Data Domain Architect · JPMorgan Chase

Aug 2019 – Jun 2022

Mumbai, India

Consumer Banking Aug 2019 – Jun 2022

  • Designed and built ETL pipelines that turn credit/debit card and digital transaction data into readable monthly in-app reports, with merchant details, geolocation and transaction amounts.
  • Designed secure handling of card and customer data (masked card numbers, KMS encryption at rest and in transit, least-privilege IAM roles) in line with PCI DSS.
  • Implemented fine-grained access control with AWS Lake Formation (column-level permissions and tag-based policies), so each line of business saw only its permitted data.
  • Set up federated data mesh governance (domain owners per line of business, a shared Glue Data Catalog and common standards), creating an enterprise data lake that modernised the consumer banking platform and fed Tableau reporting.
EMRAWS GlueLake Formation S3LambdaAthenaPySpark
TCS

Data Engineer · Tata Consultancy Services

Mar 2013 – Jul 2019

Pune, India

Global Bank Mar 2013 – Jul 2019

  • Modelled core retail banking domains (customers, accounts, deposits, loans and cards) into a dimensional data mart, with SCD Type 2 history on customer and account dimensions.
  • Built the data mart on a multi-node Hadoop cluster: batch ingestion into HDFS with Sqoop, near-real-time transaction feeds via Kafka and Spark Streaming, and a Hive layer stored in HBase for Tableau reporting.
  • Built reconciliation checks against core banking and general-ledger totals, and applied PII masking so report users saw only the customer fields they were authorised to see.
  • Helped migrate relational databases to AWS and Azure, building S3 data lakes with Glue for transformation and Athena for analysis.
HadoopHiveSqoop KafkaPySparkHBaseOozie

05 — Credentials

Education & Certifications

Education

  • B.E., Electrical Engineering SSET Bhilai (CSVTU) 2012 · 71%
  • Higher Secondary (HSC) K.V Balco (CBSE) 2008 · 71%
  • Secondary (SSC) K.V Balco (CBSE) 2006 · 88.8%

Certifications

  • AWS Certified Cloud Practitioner
  • AWS Certified Solutions Architect – Associate
  • AWS Certified AI Practitioner
  • Databricks Certified Data Engineer Associate

06 — Services

How I Can Help

Beyond enterprise delivery, I mentor and consult professionally — helping individuals and teams build stronger careers and capabilities in tech.

Resume Building

Crafting polished, ATS-friendly resumes that clearly communicate your experience and impact to hiring managers and recruiters.

Portfolio Creation

Designing and building professional personal portfolio sites that showcase your projects, skills, and career story effectively.

Technical Skill Development

Structured, hands-on mentoring to help you build real proficiency in data engineering, Big Data tools, and cloud platforms.

Big Data & Cloud Course Design

Designing structured, industry-aligned training curricula on Big Data (Hadoop, Spark, Kafka) and cloud platforms (AWS, Azure) for teams and learners.

07 — Contact

Let's build something.

Open to Data Architect, Data Engineering leadership, and Big Data solutioning conversations — as well as resume building, portfolio creation, technical mentoring, and Big Data/cloud course design. Reach out directly — I reply personally.