Hadoop developer
Charlotte, NC | 10 - 15 years of experience
Duration: Full Time
Job Description
Must Have Technical/Functional Skills
Primary Skill: Spark, Java, Hive, SQL
Secondary: Unix, Kafka, Python
Experience: 10+ years
Roles & Responsibilities
We are seeking a highly experienced Hadoop Spark Developer with 10+ years of expertise in Big Data technologies, including Java, Spark, Hadoop Ecosystem and Hive. The ideal candidate will be responsible for designing, developing, optimizing, and maintaining large-scale data processing solutions. Experience with Microsoft Copilot for AI-assisted development and productivity enhancement is highly desirable. The developer should hold a bachelor's or master's degree.
The candidate should possess strong analytical skills, hands-on experience in distributed data processing, and the ability to work closely with business stakeholders, architects, and data engineering teams.
Design, develop, and maintain scalable Big Data solutions using Hadoop and Spark.
Build and optimize ETL/ELT pipelines using Java, Spark, Hive, and Python.
Process and analyze large datasets in distributed environments.
Develop high-performance Spark jobs and optimize existing workloads.
Create and manage Hive tables, partitions, views, and complex queries.
Implement data quality, data validation, and reconciliation frameworks.
Perform code reviews and ensure adherence to coding standards and best practices.
Utilize Microsoft Copilot to accelerate development, automate code generation, troubleshooting, documentation, and testing activities.
Strong experience building both batch and real-time streaming applications with Kafka.
Collaborate with Data Architects, Data Scientists, Business Analysts, and DevOps teams.
Troubleshoot production issues and perform root cause analysis.
Design data ingestion frameworks for structured, semi-structured, and unstructured data.
Participate in Agile ceremonies including sprint planning, estimation, and retrospectives.
Mentor junior developers and provide technical leadership.
...Level II NDT Inspector System One is seeking a qualified Level II NDT Inspector for a full-time opportunity in Clairton, PA . This position is responsible for performing nondestructive testing (NDT) inspections to verify the integrity of materials, equipment, and...
...the ability to clearly convey design intent to internal teams, clients, and consultants. Education: Graduate of an accredited architectural program (B.Arch or M.Arch). Licensure: Architectural licensure not required but encouraged. Self-Directed: Ability to work...
...services and capabilities through the growth of our key asset- our staff. Ranked among the nation's top A/E firms by Engineering News-Record, LiRo-Hill provides construction management, engineering, environmental, architectural, and program management solutions. You can...
...We're fixing the student debt crisis with an innovative, yet simple solution. Join us as an on-campus Growth Marketing Intern at a fast growing company! Who we are. LeverEdge is the first collective bargaining group for student loans. Over the past year, we've saved...
Respiratory Therapist (RRT) 13-Week Travel Contract Location: Glenwood Springs, CO Facility: Valley View Hospital Job Type: 13-Week Contract Schedule: 3 x 12-hour Day Shifts with weekend rotation (36 hours/week) Start Date: November 3, 2...