The Data Engineer is responsible for designing and implementing data validation test procedures, API based regression testing, and performance and scalability testing for the Black Duck KnowledgeBase. This position reports to the VP Engineering - KnowledgeBase.

The ideal candidate has prior experience working in a Linux environment with large datasets and REST APIs, using test frameworks and build tools with experience in Python/Java,and SQL.

Responsibilities include, but are not limited to:

• Identify potential sources of data quality issues to create automated functional, performance, and regression tests for the Black Duck KnowledgeBase
• Analyze statistics and trends across the ‘Big Data’ set to detect anomalies and trace them to potential systemic issues
• Research and recommend improvements to data collection and metadata extraction methodologies
• Create and maintain test suites for Black Duck Knowledge Base data quality
• Execute, measure, and report on test runs
• Define and implement REST API based regression and performance testing
• Become expert in the structure and contents of OSS data sources (e.g. github, npmjs.org, NVD)
• Work closely with KB engineering in early product phases to facilitate Black Duck’s agile development methodology
• Track features and bugs (Jira)

Requirements:

• 4+ years of relevant experience (or 2+ years small company experience)
• 2+ years’ experience as an engineer working in Linux and RDBMS environments
• Strong troubleshooting skills
• Must have experience with Python/Java, SQL, and Web technologies
• Familiarity with unit testing frameworks and build tools e.g. JUnit, TestNG, Jenkins
• Strong Linux and shell programming skills (Bash, Python, scripting, etc.)
• Understanding of software development life cycle
• Excellent communication skills - able to interface with multiple groups across the company

About Black Duck

Organizations worldwide use Black Duck Software’s industry-leading products to secure and manage open source software, eliminating the pain related to security vulnerabilities, compliance and operational risk. Black Duck is headquartered in Burlington, MA, and has offices in San Jose, CA, London, Belfast, Frankfurt, Hong Kong, Tokyo, Vancouver, Seoul and Beijing. 

For more information, visit www.blackducksoftware.com

Interested applicants may apply via Black Duck Careers