Data Engineer

Description

Job Description:

We are seeking a passionate Data Engineer/Software Engineer, looking to make an impact on the world. Our engineering teams are highly adept at solving complex problems with the application of leading-edge technology, empowering the intelligence and war-fighter communities as they make mission-critical decisions. The Data Engineering team utilizes modern software tools to integrate with external data providers, ingest historical data, and stream in near real time to our user communities. Our team ensures that over 600 data sets are integrated, flowing, accurate, and reliable: making a direct impact to mission, in a dynamic environment. This sub family is responsible for performing the software engineering function, including the design, development, testing, troubleshooting, and debugging of software programs for enhancements and new software-intensive systems and products. Applies appropriate principles, standards, processes, procedures, and tools throughout the software development life cycle. Duties include software requirements analysis, analysis of hardware compatibility, development of software products and tools used for design, development and maintenance of infrastructure, and platforms. IMPACT: Works independently to achieve day-to-day objectives with significant impact on operational results or project deliverables. Responsible for entire projects or processes within a technical area. Typically, responsible for coaching and reviewing the work of lower-level technical staff. COMPLEXITY: Develops technical solutions that require collaboration with internal experts, deep analyses and understanding of impact on end-product/solution. Develops solutions to technical problems and issues that are unclear and require deep technical knowledge. COMMUNICATIONS: Communicates with internal and client project team members. Works to influence team members regarding solution design, process and/or approaches.

Primary Responsibilities:

• Work with external data providers and stakeholders to engineer the ingest and distribution of mission-relevant data feeds into the FADE data ecosystem.
• Focus on the operations of COTS and GOTS software to ensure low latency, high data integrity, quality, and availability for over 600 data feeds (and growing).
• Work with users to help them troubleshoot and resolve issues with FADE data sets.
• Work in a fast-moving environment with many moving parts and be able to manage several tasks at once.
• Work with a highly qualified team to maintain the integrity of data flow by responding to real-time operational alerts.
• Bring a continuous delivery mindset while achieving high availability goals for the flow of data through the system.
• Configure and maintain data ingest work-flows (ETL) across several production systems
• Install, configure, and update a wide array of COTS/GOTS and homegrown software applications
• Support and troubleshoot diverse IT infrastructure hardware platforms and protocols
• Work with software development and systems administration staff to monitor and troubleshoot production systems
• Generate and maintain systems documentation and diagrams
• Troubleshoot network issues and establish new connectivity
• Monitor and maintain a variety of databases

Basic Qualifications

• Typically requires BS and 4 - 8 years of prior relevant experience or Masters with 2 - 6 years of prior relevant experience.
• Strong software scripting skills in Python and other scripting languages (Bash, Perl, etc.)
• Prior experience of RDBMS databases (PostgreSQL, Oracle, MySql, etc.)
• Prior experience working with the Git version-control system
• Familiarity with Commercial Cloud Systems (AWS)
• Experience with Continuous Delivery/Integration tools such as Docker, Kubernetes, GITLAB Runners, etc.

Preferred Qualifications

• Must be certified to meet DoD 8570 level IAT-II qualifications. Security+ certification or CISSP preferred.  This certification must be obtained within 6 months of hire if not already certified.
• Strong systems engineering background
• Experience developing in a Linux environment preferred
• Understanding of Amazon Web Services – EC2, RDS, S3
• Hadoop, Accumulo and Map Reduce techniques
• Familiarity with monitoring tools such as Grafana and Kibana 
• Familiarity with message broker software such as Kafka
• Familiarity with data streaming applications such as Storm
• Understands compiled languages including Java

Pay Range:

Pay Range $66,300.00 - $102,000.00 - $137,700.00

The Leidos pay range for this job level is a general guideline only and not a guarantee of compensation or salary. Additional factors considered in extending an offer include (but are not limited to) responsibilities of the job, education, experience, knowledge, skills, and abilities, as well as internal equity, alignment with market data, applicable bargaining agreement (if any), or other law.