Remote Big Data Engineer – Hadoop, Hive, Spark & Python Development (Live Chat Support)

• --

About arenaflex

Welcome to arenaflex, a global leader in innovative financial services and technology solutions. We are currently seeking a talented and motivated professional to join our dynamic team as a Remote Big Data Engineer. This is an exciting opportunity to work with cutting-edge technologies while enjoying the flexibility of remote work. At arenaflex, we believe in empowering our employees to achieve their best through continuous learning, collaborative work environments, and comprehensive benefits that support both professional and personal growth.

Our commitment to excellence drives everything we do, and we are looking for individuals who share our passion for innovation and technological advancement. Join arenaflex and become part of a company that values creativity, diversity, and the power of data to transform businesses and customer experiences.

Position Overview

arenaflex is seeking a skilled Big Data Engineer to design, build, and maintain our enterprise data infrastructure. In this role, you will work closely with utility teams to define, develop, and implement robust data solutions that power our business intelligence and analytics capabilities. This position offers the unique opportunity to work with massive datasets and cutting-edge technologies while contributing to transformative projects that shape the future of our data platform.

As a Big Data Engineer at arenaflex, you will play a critical role in expanding our Voice of the Customer methods and leveraging these insights to transform data within our cornerstone big data platform. You will be responsible for creating scalable solutions that ensure data quality, accuracy, and accessibility across the organization.

Key Responsibilities

• Data Architecture Design: Design and build robust data model architecture to support optimal data processing and standardized metric definitions that drive business intelligence.


• Big Data Development: Develop big data and batch/real-time analytical solutions using transformational technologies including Hadoop, HDFS, MapReduce, Hive, Spark, and Python to deliver innovative solutions.


• Quality Assurance: Ensure data quality and accuracy through intensive testing at variable and use case levels, implementing rigorous validation processes.


• Performance Optimization: Provide guidance to enhance capabilities and drive efficiency in computing programs using the massive data ecosystem.


• Consumer Analysis: Power consumer tale analysis and elaboration, design and development of software programs, and build automation tools.


• Process Automation: Proactively identify and automate manual tasks to improve quality and operational efficiency across data pipelines.


• Cross-Functional Collaboration: Work closely with partners from various business units to prioritize, define, develop, and test data for different use cases as part of comprehensive data solutions.


• Technical Leadership: Translate complex business requirements into technical deliverables while collaborating with product owners and relationship managers.


• Agile Delivery: Participate in Agile methodologies with small increments of product delivered at regular intervals to business groups.

Essential Qualifications

• Technical Experience: Hands-on development experience with Hive/Hadoop, Pyspark, Python, Shell Scripting languages, deployment management, and troubleshooting for data-driven projects spanning a minimum of 3+ years.


• Collaboration Skills: Active collaboration with relationship managers and product owners to understand functional requirements and convert them into technical deliverables.


• Agile Methodology: Familiarity with Agile delivery methods where small increments of a product are introduced at regular intervals to business groups.


• Communication: Strong written and verbal communication skills to effectively interact with technical and non-technical stakeholders.


• Problem-Solving: Excellent analytical and problem-solving abilities to address complex data challenges.

Preferred Qualifications

• Experience with cloud-based big data platforms and services.


• Knowledge of real-time streaming data processing frameworks.


• Familiarity with data warehousing concepts and ETL processes.


• Understanding of machine learning integration with big data pipelines.


• Previous experience in financial services or fintech industry.

Required Skills and Competencies

• Technical Proficiency: Deep expertise in Hadoop ecosystem components including HDFS, MapReduce, Hive, and Spark.


• Programming Skills: Strong proficiency in Python and Pyspark for data processing and analysis.


• Scripting: Advanced Shell Scripting capabilities for automation and system administration.


• Data Modeling: Ability to design scalable and efficient data models for enterprise applications.


• Testing: Experience with data quality validation and comprehensive testing methodologies.


• Time Management: Excellent ability to multitask and prioritize responsibilities in a fast-paced environment.

Career Growth Opportunities

At arenaflex, we are committed to the professional development of our employees. This position offers numerous opportunities for career advancement, including:

• Exposure to emerging technologies and big data trends.


• Mentorship from senior technical leaders and domain experts.


• Leadership opportunities in technical projects and initiatives.


• Cross-functional training and skill development programs.


• Clear career pathways to senior engineering and architectural roles.


• Participation in industry conferences and professional development events.

Work Environment and Culture

arenaflex fosters a supportive and inclusive work environment where innovation thrives. As a remote employee, you will enjoy:

• Flexible work-from-home arrangements with modern collaboration tools.


• A collaborative team culture that values diverse perspectives and ideas.


• Access to cutting-edge technologies and development resources.


• Regular virtual team meetings and cross-functional projects.


• A culture that prioritizes work-life balance and employee well-being.


• Comprehensive onboarding and ongoing training support.

We returned our colleagues and their families with blessings and programs that support their holistic well-being. This means we prioritize their physical, financial, and intellectual health through each stage of their career and life.

Compensation and Benefits

arenaflex is pleased to offer a competitive compensation package that includes:

• Hourly Rate: Highly competitive rate of $35 per hour.


• Remote Work: Full flexibility to work from the comfort of your home.


• Health Benefits: Comprehensive healthcare coverage for employees and their families.


• Retirement Plans: 401(k) and retirement savings programs with company matching.


• Professional Development: Access to training resources, certification programs, and educational opportunities.


• Paid Time Off: Generous vacation and personal time off policies.


• Employee Assistance: Programs supporting mental health, financial planning, and work-life balance.

How to Apply

If you are passionate about big data technologies and want to advance your career with a leading organization, we would love to hear from you. This is an excellent opportunity to join arenaflex and contribute to innovative projects that make a real impact.

Apply now to join our team and become part of a dynamic organization that values talent, innovation, and diversity. Take the next step in your career with arenaflex today!