Remote Opportunity - Python-PySpark Developer Job at IT America Inc, Illinois

UndTZWRIVWVVVjFBRjRnZjcxMHZVSXRu
  • IT America Inc
  • Illinois

Job Description

Position: Python/PySpark Developer

Location: Remote

Duration: Long term contract

Job Summary

We are seeking a skilled and experienced Python/PySpark Developer with hands-on expertise in Databricks, Cloud platforms (AWS, Azure, or GCP), and CI/CD pipelines. The ideal candidate will design and develop scalable data pipelines, work on big data processing frameworks, and contribute to modern data architecture initiatives.

Key Responsibilities

  • Design, develop, and maintain data pipelines using PySpark and Python.
  • Proficiency in working with SQL, and relational and non-relational databases.
  • Work with Databricks to build scalable and high-performance ETL/ELT workflows.
  • Integrate and process structured and unstructured data from various sources.
  • Deploy solutions on any major cloud platforms (AWS, Azure, or GCP).
  • Implement CI/CD pipelines to automate build, test, and deployment processes.
  • Optimize data workflows for performance and cost efficiency.
  • Collaborate with Data Engineers, Data Scientists, and DevOps teams.
  • Maintain documentation of design decisions, architecture, and implementations.
  • Troubleshoot and resolve data pipeline issues in a timely manner.

Required Skills

  • 10+ years of experience with Python and PySpark.
  • Proficiency in working with SQL, and relational and non-relational databases.
  • Strong experience with Databricks (Delta Lake, notebooks, jobs, clusters, etc.).
  • Experience with one or more cloud platforms (AWS, Azure, GCP).
  • Solid understanding of CI/CD tools (e.g., GitHub Actions, Jenkins, Azure DevOps).
  • Experience with data orchestration tools (e.g., Airflow, Databricks Workflows).
  • Familiarity with data lake, data warehouse, and big data concepts.
  • Knowledge of version control systems like Git.
  • Strong problem-solving and debugging skills.

Preferred Qualifications

  • Experience with Terraform, Docker, or Kubernetes.
  • Exposure to machine learning pipelines or MLOps is a plus.
  • Certifications in Databricks or any Cloud Platform are a bonus.

Education

  • Bachelor's or Master's degree in Computer Science, Engineering, or related field.

Job Tags

Contract work, Remote job,

Similar Jobs

Odyssey Staffing

Certified Registered Nurse Anesthetist (CRNA) - Anesthesiology - Georgia - Locum Tenens position Job at Odyssey Staffing

Welcome to an Exciting Opportunity! We are looking for multiple Locum CRNAs to join our team south of Atlanta. If you are ready to work full-time starting in 60 days, we want to hear from you! Responsibilities: Candidates must have full-time availability and be willing...

NKH Agency

Exciting Sales Career, Work From Home Job at NKH Agency

 ...Description: Already working a 9-5 and looking for...  ...build your business from home. You're also able to...  ...our sales agents spend time selling and not prospecting. Job Details: Part-Time, Remote Working, able...  ...own boss. No sales experience is welcomed too! We will... 

Better Car People

Remote Chat Agent Job at Better Car People

Be a Part of Something Amazing At Better Car People, LLC, we are the leader in Automotive Customer Engagement. Our employees are committed to success with enthusiasm and a passion for sales, customer service, and technology. We keep our employees delighted with perks ...

State of Florida

DVOP/LVER GOVERNMENT OP CONSULT II - 40034326 1 Job at State of Florida

 ...In collaboration with our partners, we salute our nations veterans and are honored to have the opportunity to support them and their...  ...documentation, DD form 214 and/or current US Department of Veterans Affairs (VA)/ Defense letter reflecting character of discharge is... 

Get It - Marketing

Insurance Account Position - State Farm Agent Team Member - Remote Job at Get It - Marketing

 ...and results-driven Sales Associate to join our team remotely. As a key member of our sales force, you will use your knowledge of insurance products and industry trends to build strong, lasting relationships with clients. You'll have the chance to engage with potential...