Job Description
Responsibilities :
1. Work in big data. Take existing solutions, optimize and build high-performance algorithms. Scale algorithms on terabytes of data. Improve time complexity and space complexity of data pre-processing. Recommend ways to improve data reliability, efficiency and quality.
2. Process structured and unstructured data, validate data quality, help to design data quality tests in big data environment.
3. Help to develop and support data products. Develop data set processes for data modeling, mining and production.
4. Work closely with engineers and data scientists. Help data science team and engineers to improve spark performance. Be involved into data products deployment.
5. Create custom software components using Spark or PySpark (e.g. specialized UDFs) and analytics applications.
6. Help to create visualization tools for tracking model performance and data quality. Integrate new data management technologies and software engineering tools into existing structures.
7. Collaborate with data architects, engineers, data scientist, business team members on project goals.
Minimum qualifications:
- BS degree in a quantitative field such as statistics, operations research, computer science, mathematics, physics, electrical engineering, industrial engineering.
-2 years of relevant work experience in big data analysis or related field (data engineer/developer).
-Expert in Spark, Python/ or R, PySpark/ or SparkR, Scala, SQL/Hive
- Familiar with Spark MLlib, SparkSQL
-Accomplished in Hadoop-based data mining frameworks.
Preferred qualifications:
- MS or PhD degree in a quantitative field.
- 2-3 years of relevant work experience, including deep expertise in Spark.
...Job Description About this Position: Job Title: Java ESB Architect Required Skills/Experience: ~10+ years Java Development on Java 8+JDK solid Object-Oriented design programming. ~ Advanced experience in working with stakeholders to design, implement...
...what you can do. Valley View Medical Center is a state-of-the-art hospital is licensed with 52 medical/surgical beds, 12 acute... ...disability, genetic information, gender identity, sexual orientation, veterans' status or any other basis protected by applicable federal, state...
...Part-Time Warehouse Associate Outbound Our warehouse operations make sure that products are properly received, selected and delivered to our stores for our ever-growing number of customers to enjoy. While not guaranteed, on average our warehouse employees work 32 hours...
...As a Netflix Tagger , youll watch movies, TV shows, documentaries, and other original content on Netflix and assign relevant metadata and tags that help improve Netflixs recommendation algorithm. Your insights help personalize what millions of viewers see when they...
...Allied Universal, North Americas leading security and facility services company, offers rewarding... ...security-related, law enforcement, and/or military experience is required. Customer service experience is preferred. A guard card or license is preferred. Access...