Sr Data Engineer II - IT Division

Summary

Oversees and/or participates in designing and implementing data management infrastructure. Researches best practices and/or participates in building, automating, and maintaining data management systems that combine core data sources into repositories to enable reporting/visualization and analysis of data. Oversees and/or participates in writing or improving code to handle complex data processing tasks. Oversees and/or participates in product development of internal systems, tools, and platforms. With limited direction, identifies key opportunities for improvement and technical/process enhancement to increase operational efficiencies. Explores and queries datasets, cleans and transforms data, and may develop dashboards and visualizations. Has an expert ability to use tools and technologies that protect the security of Board data.

Duties and Responsibilities

• With limited guidance, influences building and architecting next generation data management platforms on a group of core technologies. Defines the process necessary for and/or participates in developing, maintaining, and optimizing data management solutions that ensure high availability of data availability, data scalability, data quality, data integrity and data security. Oversees and/or participates in exploring new datasets, promoting data discovery and understanding, revising existing data and building and maintaining data views and aggregate data series. Queries datasets and cleans/transforms data of high complexity.
• Has an expert understanding of new/key technologies and platforms and how to incorporate third party APIs and open source/reusable components. Uses expert knowledge of new/key technologies to provide recommendations that influence the implementation of innovative solutions.
• Oversees the process of and/or participates in utilizing lean and agile software development practices such as test-driven development, refactoring, continuous integration and deployment, version control, and simple design to create quality, reusable- code. Oversees and/or participates in writing or improving code to handle complex data processing tasks, or rewriting old processes written in older languages. Oversees and/or participates in collecting ongoing data updates from external sources to establish and maintain software code used to convert raw data into usable formats.
• With limited guidance, creates and maintains programs and processes necessary to provide data for production and research. Oversees and/or participates in implementing processes and programs that monitor data quality, logging and responding to production issues, and ensures production data is always accurate and available for key stakeholders/customers and business processes that depend on it.
• Oversees and/or participates in product development of internal systems, tools and platforms supporting operational capabilities. Outlines the process for and/or participates in transitioning existing products out of legacy technology platforms. Creates new products as ad hoc requests arise.
• Communicates across technical and business product managers, as well as third parties, on complex solution design topics.
• Oversees and/or participates in integrating data from multiple sources to employ complex features of integration technologies. Reviews and refines recommendations developed by more junior staff and/or develops recommendations related to data integration strategy in order to meet future reporting and analytic needs.
• With limited guidance, influences the designing, constructing, and implementing of a database system to meet strategic needs. Researches best practices and/or participates in building data management systems that combine core data sources into data repositories to enable reporting and analysis of data. Oversees the process of and/or participates in developing, maintaining, and automating data pipelines that ingest data from a wide variety of structured, semi-structured, and unstructured data formats. Provides recommendations on database development requests.
• With limited direction, identifies key opportunities for improvement and technical/process enhancement to increase operational efficiencies, address future technological needs, and reduce costs associated with the use of internal tools.
• Oversees and/or participates in safeguarding digital data throughout its entire lifecycle to protect it from corruption, theft, or unauthorized access. Has an expert ability to use tools and technologies that protect data in transit and/or at rest through processes like data masking, encryption, and redaction of sensitive information. Coaches more junior staff through and/or participates in setting access permissions. Implements fine-grained access rules, such as row-level and column-level filters and restrictions. Incorporates security practices in developing APIs.
• Utilizes advanced to expert knowledge of key components of cloud computing and one or more cloud technology platforms. Outlines and/or participates in evaluating use cases to determine which cloud tools and services best fit a client’s needs.
• Oversees and/or participates in gathering and analyzing various quantitative and qualitative data to provide useful information and actionable recommendations to clients. Based on data analysis, illustrates and reports data findings using expert knowledge of visual charts, figures, tables, and dashboards to tailor findings to specific audiences.
• Remains aware of and adheres to applicable governing standards. Independently conducts regular audits of projects, processes, and operational activities and documents findings.
• Oversees and/or participates in governing large volumes of both structured and unstructured data. Oversees and/or participates in designing, developing, automating, and troubleshooting data flows and pipelines to process large quantities of data.
• With limited assistance, proactively troubleshoots, diagnoses, documents, and resolves escalated support problems as assigned. Explains technical problems/solutions to non-technical individuals, in order to provide context for how the issue was resolved. Helps more junior staff develop these abilities.
• Oversees and/or participates in writing documentation for new and existing productions processes and data items. Ensures up-to-date documentation is available and written in a clear and succinct manner.
• Oversees project teams through the cycle of a project, ensuring expectations are set, deliverables are defined, and risks are outlined.

Remarks:

Position Requirements:

Requires a bachelor's degree or equivalent plus six years of experience. Must have expert knowledge in one or more of the following areas: cloud technology, relational and NoSQL database design/development, data analysis, data security, technology compliance, big data management, data workflow management and automation, data pipeline, data catalog, metadata management, data ingestion, data transformation and data exchange. Must be able to lead technical support, database administration, technical problem solving, technical documentation, data visualization, code creation/maintenance, data integration, and production development/maintenance. Highly desirable skills include:

Demonstrated experience in project leadership and management

Demonstrated experience with Agile engineering practices including developing user stories and managing customer expectations

Demonstrated experience using Databricks including Unity Catalog, Declarative Pipelines, and Declarative Asset Bundles for data ingestion and storage

Demonstrated data platform architecture experience focused on cloud-based data ingestion and storage

Demonstrated experience with Infrastructure-as-Code frameworks, CI/CD pipelines, and automated deployment workflows

2+ years of experience with R programming for data manipulation, transformation, and analysis

Experience with data wrangling and reshaping operations (e.g., pivoting, joins, aggregations)

SQL proficiency for querying databases, creating views, and data extraction

 

We are an Equal Opportunity Employer and do not discriminate against any employee or applicant for employment on the basis of race, color, religion, sex, pregnancy, national origin, age, disability, genetic information, or application, membership, or service in the uniformed services.

Job Details
Primary Location: US-DC-Washington
Employee Status: Regular
Overtime Status: Exempt
Job Type: Standard
Relocation Provided: Yes
Compensation Grade Low: FR PAY GRADE 27
Compensation Grade High: FR PAY GRADE 27
Posting Date: Jul 28, 2026, 7:21:22 AM