AWS Data Engineer II | Jobs with Virtelligence

Location: Pennsylvania Country: United States

Mark Adam is recruiting this position.

Job Responsibilities

Design and architect real-time data streaming architecture on AWS.
Design and implement streaming ingestion pipeline to load data from bed side devices (both discrete vitals and waveform data)
Utilize software development best practices such as version control via Git, CI/CD, and release management to build and deploy the streaming services and pipelines.
Build automated data validation processes to ensure the quality and integrity of the datasets.
Implement appropriate monitoring and observability solutions.
Monitor cloud application performance for potential bottlenecks and resolve performance issues

Skills requirements

Experience working with Kafka, Spark Streams, RabbitMQ, Snowflake, Grafana, Prometheus, AWS services - S3, Kinesis, SQS, TimeStream, Redshift, CloudWatch, EKS
Experience working with HL7 data
Experience coding with Python/Java
Strong SQL, Data Warehousing and Data Lake fundamentals.
Hands-on experience with Linux (RHEL/Debian) operating system
Knowledge of version control systems such as Git.
Experience consuming and building APIs
Experience utilizing Agile methodology for development

Education:

Proficiency in appropriate Business Intelligence/Data Warehousing technology or subject domain.
Bachelor’s degree in computer/Analytics/Data Science related field.

3-6 years of Business Intelligence/Data Warehousing experience, preferably in a healthcare & research environment.