Hadoop EngineerApply Job ID 17335 Date posted Jun. 29, 2020 Location Sussex, Wisconsin Full Time / Part Time Full time (FT)
Job Title: Hadoop Engineer
Job Location: Sussex, WI
Major Responsibilities: Perform data modeling in RDBMS (transactional, data warehousing) on MSSQL, Oracle, Sybase ASE as well as Hadoop data modeling & design. Create and manage frameworks for data management, processing, and analytics. Develop and manage applications and frameworks within the Hadoop ecosystem (Yarn, HDFS, Spark, Hadoop, Impala, Kafka, Kudu, etc). Create HDFS file system design using techniques, format, and layout for optimal performance. Develop applications in spark and use scala or java to support analytics, predictive, and ETL/ELT. Develop, deploy, and monitor application and server performance in developed applications (yarn, map reduce, spark). Ensure Performance Tuning of Map Reduce, Spark and other applications within Hadoop. Manage Data Analytics and Data Visualization such as Tableau, PowerBI, Qlik. Design and develop applications utilizing data streaming such as Spark, Kafka and Flume. Ensure Machine Learning and AI Skills in Scala and Python in spark. Engage in Statistical Analysis, Machine Learning, Data Mining, Tableau, Hadoop, R, BigQuery and TensorFlow. Deliver Hadoop solutions using the Hadoop ecosystem. Work in data analytics, data warehousing or similar. Design enterprise data modeling concepts, ETL, and advanced SQL programming languages such as Scala/Java in Spark using data frames and RDD. Design, deploy, and monitor Spark applications.
Job Requirements: Applicant must possess a Bachelor's or foreign equivalent degree in Computer Science, Statistics, Applied Math or in a related field and 1 year of professional experience developing and supporting Hadoop Ecosystem projects with a strong emphasis on data architectures leveraging Spark, Hive and HDFS as part of an enterprise level data analytics team or in a related position. Additionally, the applicant must have professional experience in: 1.) 1 year of experience in Enterprise Data Modeling Relational: Relational Database experience (ex. Oracle, SQLSERVER, Sybase DBMS); 2.) 1 year of experience in HDFS Design: HDFS file system design using techniques, format, and layout for optimal performance; 3.) 1 year of experience in Hadoop Ecosystem Components: Advanced understanding of proper utilization, management and design of Hadoop applications for data management, processing, and analytics within the Hadoop Ecosystem. (HDFS, Spark, Hadoop, Impala, Kafka, etc.).; 4.) 1 year of experience in Hadoop Batch Application Development: Develop and manage spark framework based applications within the Hadoop Ecosystem using Scala or Java development languages; 5.) 1 year of experience Hadoop Streaming Application Development: Design and develop applications utilizing data streaming such as Spark, Kafka and Flume; 6.) 1 year of experience Hadoop Application Performance: Deploy applications and monitor applications and/or server performance. Focus on performance monitoring and apply tuning techniques of Map Reduce, Spark and other applications within Hadoop; 7.) 1 year of experience Data Visualization: experience with Data Analytics and Data Visualization tools similar to Tableau, Power BI, Qlik; 8.) 1 year of Data Analytics experience: Work in data analytics, data warehousing or similar; and 9.) 1 year of experience Query Languages: Experienced with advanced SQL programming and Spark SQL using data frames.
Visit www.bequad.com for a complete job description, job duties & requirements, & to apply.
We offer excellent benefits to eligible employees, including 401(k), holidays, vacations and more.
Quad/Graphics is an equal employment opportunity employer. The Company’s policy is not to unlawfully discriminate against any applicant or employee on the basis of race, color, sex, sexual orientation, gender identity, religion, national origin, age, military or veteran status, disability, genetic information or any other consideration made unlawful by applicable federal, state, or local laws. The Company also prohibits harassment of applicants and employees based on any of these protected categories.
Categories at a glance
Explore available opportunities by job type, click each to learn more.
Develop sales strategies to help solve our clients’ challenges and grow their business.
Concept and design compelling campaigns and products for leading retailers, publishers and brand marketers.
Develop plans to buy and schedule media to support clients' marketing objectives from print to digital media and broadcast.
Gain real-work experience through internships and trainee programs with strategic entry-level opportunities.
Make an impact in strategic administrative roles that include information technology (IT), accounting, legal and marketing.
Make quality print products in a highly automated and technologically advanced environment.
Be part of a team that drives our success.
Electrical & Mechanical
Be a problem solver and join a team that ensures our facilities, offices and equipment are running efficiently.
Manage client relationships and their projects from within a facility, creative studio or in the client’s on-site location.