OTC Markets Group Inc Data Engineer in New York, New York
OTC Markets Group Inc. , operator of premier US financial marketplaces, is seeking a passionate and dedicated Spark/Scala/Kafka Data Engineer with three to five years of experience to join our Cloud Data Reporting team based in our New York, NY office. Our team is responsible for building the next generation real-time applications which include but are not limited to internet and internal websites, real-time application tools and various internal processes. We utilize a home-grown Spark based platform to execute monitoring, surveillance analytics and data mining on the data sets. We are looking for a talented Data Engineer to work in the Data Reporting Team building and scaling the next generation data platform. As a member of the team you will work in an intimate, collaborative environment along with other Engineers to create systems that organize, analyze, and maintain the data for the firm.
You will participate in the continuous advancement of the data infrastructure in our company and support the large data sets required to expand our product lines to provide the best (real-time) information possible. In addition, you will collaborate with a stellar engineering team to ensure our support process is more efficient, get projects done in a timely manner and work as a team to be an integral part in the success of the company. If you are up to the challenge and are comfortable multi-tasking while building relationships across the organization then this is an exciting and amazing opportunity a for you to be part of a team which will continue to embark on both new technologies and our cloud initiative. Our clients include domestic and international companies, both public and private.
OTC Markets Group’s newly redesigned headquarters foster an open and collaborative environment for employees and clients, utilizing more than 33,000 square feet of space. Our NY office is located in Brookfield Place, in the heart of the financial district, surrounded by Hudson River Park and home to luxury retail and dining establishments, featuring extensive public space and world-class amenities.
Our Core Values are incorporated in each aspect of our Company. We encourage autonomy, professionally passionate discussions of opposing viewpoints, creativity and transparency. We are Open, Transparent, and Connected. We are OTC strong. At OTC Markets, we all win together.
We invest heavily in employee satisfaction and offer all our employees a highly competitive compensation package. As a dynamic, growing company that fosters an open culture, we emphasize autonomy, responsibility, innovation and self-discipline. We are looking for someone who wants to make an impressive impact at a company known for its reputation on quality and achievement.
The Data Engineer will be provided with the tools needed for success including a team of passionate individuals who are there to support your achievements and celebrate the wins!
Please note, due to COVID-19, OTC Markets is currently operating in a remote work environment with the voluntary option to work in-office a few days a week. This is a temporary adjustment to the start date work location with phase-in updates provided by the Human Resources team.
Our successful candidate will:
Code and test reliable and resilient real-time Spark Applications.
Learn our architecture and start to contribute immediately as we value and encourage brainstorming and input from everyone on the team.
Participate in all phases of the SDLC including but not limited to architecture, technical design and documentation, testing, implementation and product launch.
Write unit/integration tests as part of the development initiative providing great test coverage which will enable continuous delivery of code.
Implement readable, maintainable, and highly performant Scala/Python code.
Use many of the available AWS services to build applications.
Create and maintain technical documentation and architecture diagrams.
Support projects through their entire lifecycle from analysis to production rollout.
Plan and coordinate project schedules, goals, and milestones.
Collaborate with the business stake holders on the feature set specifications.
Collaborate with team members on the implementation and planning.
If you are excited to code in Scala/Python with Spark, Kafka and AWS services, deliver projects from start to finish, and most of all work in a fantastic work environment, then review the requirements below, and see if you are a good fit. We will provide any required training and mentoring to bring you to the next level. We are passionate and use the best of breed new technology. We are looking for engineers who are not afraid to ask questions and reach out to the internal teams and external message boards for help. You will write and own the microservices to support both the business lines and the technical implementation. As you grow in the company you will mentor new team members.
Data Engineering - 3-5 years’ experience with AWS, Scala, Spark, Kafka, S3, Python
Spark streaming and optimization
You have experience with continuous integration/deployment and Scala build tool.
Good Debugging Skills, excellent troubleshooting skills
Must be self-motivated and willing to learn. You love to stay on top of new technology and share with others.
Good knowledge of SQL. The ability to recognize when you require input from the DBA team.
Excellent verbal and written communication skills with employees both onsite and in remote locations.
Proven ability to work with individuals at all organization levels.
Ability to work on concurrent projects, when required.
Ability to develop a detailed project plan when working on a project.
Support production issues when required.
Experience in agile project development.
Must know how to use GIT.
Strong Linux knowledge.
Nice to haves:
You have experience with key AWS services, such as EC2, RDS (Postgres, Aurora), Lambda, Athena
Experience working with equity financial data (Quotes, Trades, Company Information)
You have worked with large data sets.
You have worked in the Financial Markets.
Please note, we will neither sponsor nor relocate for this position.
What OTC Markets offers its Team Members (why you should choose us):
Generous vacation policy in addition to 9 annual holidays observed and Summer Fridays.
Snacks and sodas and a very chic coffee bar.
Annual bonus and stock incentive program.
Office refreshments and company happy hours.
Monday Bagels and Friday Pizza.
Life and disability insurance, including paid parental leave.
Health insurance plans designed to meet the various coverage needs and preferences (Medical, Dental, Vision).
Flexible Spending Accounts for health, transit, parking and dependent care, as well as Healthcare Savings.
Accounts for qualifying plans.
Come as you are and just be you. We are an equal opportunity and e-verify employer and prohibit discrimination and harassment of any kind. All employment decisions are based on business needs, job requirements, and individual qualifications, without regard to race, creed, color, religion, gender, national origin, age, marital status, political belief, physical or mental disability, sexual orientation, military or veteran status, genetic information, family or parental status, gender identity, pregnancy, including childbirth or related medical condition, or any other characteristic protected by federal, state, or local law. We encourage applicants of all ages and backgrounds.
OTC Markets Group Inc. (OTCQX: OTCM) operates Open, Transparent and Connected financial markets for 10,000 U.S. and global securities. Through our OTC Link® ATS, we directly link a diverse network of broker-dealers that provide liquidity and execution services for a wide spectrum of securities. We organize these securities into markets to inform investors of opportunities and risks: the OTCQX® Best Market; the OTCQB® Venture Market; and the OTC Pink® Open Market. Our data-driven platform enables investors to easily trade through the broker of their choice at the best possible price and empowers a broad range of companies to improve the quality and availability of information for their investors. To learn more about how we create better informed and more efficient financial markets, visit www.otcmarkets.com .
OTC Link ATS is operated by OTC Link LLC, member FINRA/SIPC and SEC regulated ATS.
Applicants have rights under the federal law:
Equal Employment Opportunity is the Law (https://www.dol.gov/ofccp/regs/compliance/posters/pdf/eeopost.pdf)
Polygraph Protection Act
Please no calls or 3rd party recruiter submissions.
Powered by JazzHR