About MapUp
Fleets bleed money on tolls and fuel every day: 30+ day toll bills, surprise violations, and out-of-network fuel stops. MapUp plugs the leaks. Founded in Silicon Valley and operating in 100+ countries, MapUp with its GPS + AI platform helps fleets cut toll spend, fill-up cheapest in-route fuel, and drives compliance with navigation that actually updates on the go. The payoff? Real ROI: lower costs, faster billing, happier drivers.
By turning fragmented data into real-time decisions, MapUp is building the intelligence layer for fleet economics, transforming a fragmented industry into one powered by data, automation, and insight. For more information, visit MapUp and its solutions here.
Job description
We are seeking a Senior Data Engineer to lead and optimize scalable data pipelines, ETL processes, and big data frameworks using AWS (S3, Glue, Lambda, Spark). You'll manage data warehousing on Redshift, automate workflows, and improve performance monitoring. Proficiency in SQL, Python, and AWS is essential. Familiarity with Kafka and DBT is a plus.
Responsibilities
- Data Pipeline Development: Design, build, and optimize scalable data pipelines using Python, SQL, and AWS services such as S3, Glue, EC2, and Lambda to process large datasets.
- ETL Processes: Develop and maintain ETL workflows using AWS Glue and Athena, ensuring efficient data extraction, transformation, and loading from various sources to Redshift and other storage solutions.
- Big Data Processing: Implement and manage distributed data processing frameworks using Apache Spark on AWS EMR for large-scale data transformations and analysis.
- Cloud Automation: Automate and orchestrate data workflows using AWS services like Batch, Lambda, and CloudWatch to ensure high availability and cost-effective data processing solutions.
- Data Monitoring & Optimization: Set up performance monitoring, logging, and alerting systems using AWS CloudWatch and optimize data processing workflows for improved efficiency and cost-effectiveness.
- Data Warehouse Management: Manage and optimize data warehousing solutions on Redshift, ensuring proper schema design, query optimization, and seamless data access for business users.
- Collaboration with Data Teams: Work closely with data analysts and data scientists to understand data requirements and provide efficient and scalable solutions for their data needs.
- Documentation & Best Practices: Maintain thorough documentation of data processes and follow best practices for code quality, security, and compliance within AWS environments.
- Real-Time Data Streaming: If experienced with Kafka, implement and manage real-time data streaming solutions for real-time analytics and data integration.
- Data Transformation with DBT: Utilize DBT for transforming and managing data models in the data warehouse, ensuring consistency and accuracy in the transformed data.
Experience and Skills
- Work experience: 2+ years of relevant experience.
- Education: B.Tech, BCA, B.Sc(Computers and Stats), M.Tech, MCA.
- Must have: SQL, Python, AWS (S3, EC2, Glue, Athena, Batch, EMR, Redshift, Cloudwatch, Lambda), Spark
- Good to have: Kafka, DBT.
- Experience with real-world data applications, debugging, and scaling solutions.
- Ability to lead projects, train fellow team members, and introduce new techniques.
- Demonstrated problem-solving skills with a focus on efficiency.
Good to have
- Experience with productionizing algorithms for real-time systems
- Deep understanding of Bayesian modeling
Benefits
Team
You will be joining a team of mapping experts who care deeply about their customers. We are transforming mapping into a practical decision-making tool for commuters, commercial transporters and mobility providers.
Following Are Some Of The Perks
We are a "work family", a highly collaborative, supportive, skilled, thoughtful, and intellectually curious group of people who are focused on making MapUp a great place to work! Following are some of the perks:
- Full-time, remote position.
- Competitive salary.
- Collaborative and supportive team environment.
- Flexible work schedule to promote work-life balance.
- Company-sponsored work trips.
- Opportunities for professional growth and career advancement.
For any queries, drop in a line to: hr@mapup.ai