
Real Vision
Understand the complex world of finance, business and the global economy with real in-depth analysis from real experts.
Remote Data Engineer
Remote Location
New York, NY
Job Type
Full-time
Category
Data
Who We Are
Real Vision helps people understand the complex world of finance, business, and the global economy, with real in-depth analysis, by real experts through the power of our community. We’re on a mission to democratize the very best financial intelligence for all.
Our product and engineering team is growing rapidly. We're a strong team of 20 based all over the world, headquartered in the Cayman Islands. Currently, we are looking for a Data Engineer to accelerate development of our Data Warehouse System. As a key member of our Data Warehousing Team, you will work with engineering, marketing and analytics teams to accelerate development of our existing Data Warehouse System which includes technologies such as Apache Kafka, EventStore, Spark Streaming, FastAPI, PostgresQL, AWS S3 and Liquibase among others.
We're looking for a self-motivated engineer who has a passion for building scalable, reliable and maintainable data pipelines. Data Warehousing Team at Real Vision is central to delivering and maintaining our modern data, analytics, and machine learning systems.
You'll work on:
- Work with marketing, analytics and data science team to understand their data needs. Ideate and implement data projects from scratch to enrich our Data Warehouse System to serve those needs
- Automate the data flow to continuously enrich our Data Warehouse System
- Ensure the quality of the data delivered to business
- Agile software development processes to iteratively make improvements to our Data Warehouse System
- Work with the infrastructure team to facilitate deployments of the Data Warehouse System
We are looking for someone who:
- Bachelor’s degree in computer science, information technology, engineering or equivalent
- Has at least 2 years of experience with Apache Kafka
- Has at least 3 years of experience working with Apache Spark preferably using PySpark including both batch and stream processing
- Can write good production level code in Python and have experience developing APIs with any of the popular Python frameworks such as Django, Flask or FastAPI
- Can package applications for deployment using Docker/Docker Compose
- Is comfortable with Linux OS; and can spin up and configure EC2 instances in AWS as need be. Experience with other AWS cloud services such as S3, EMR, Redshift etc., is a plus
- Has some experience with SQL and RDBMS such as PostgresQL or MySQL, and has some familiarity with database migration tools such as Liquibase
- Can derive solutions to complex problems that are scalable, reliable and maintainable
- Values simplicity and accessibility of the code over complex architectural designs
- Is a person of high integrity and have excellent work ethic
What We Offer
- Competitive salary
- 20 days accrued PTO a year (4 weeks, yup)
- US Public Holidays
- 5 sick days
- 100% covered health, dental, vision for the individual employee (with full family coverage at a heavily reduced rate)
- 4% dollar-for-dollar 401k match after 90 days
- 100% remote
- Equity grants
- Growth Opportunities
- Real Vision Pro membership
About
Real VisionSkills
Apache KafkaPySparkDjangoFlaskFastAPIDocker/Docker ComposeLinuxAWSPostgresQLMySQL
