Software Engineer – Principal

Software Engineer – Principal

Requirements

• Proficient in data manipulation and transformation, especially with large datasets.
• Experience ingesting data from various sources like Excel files, CSVs, databases, system logs, etc.
• Ability to clean and preprocess data, removing unnecessary data elements.
• Familiarity with ETL (Extract, Transform, Load) processes.
• Experience working with Elasticsearch or OpenSearch for indexing, searching, and querying large datasets.
• Ability to optimize searches and manage clusters.
• Knowledge of the Elasticsearch query DSL, indexing strategies, and performance tuning.
• Proficient in creating visualizations and dashboards in Kibana.
• Understanding of how to use Kibana for data exploration, trend analysis, and reporting.
• Experience in creating visualizations in a UI Design Framework, like React.js with Material-UI.
• Understanding basic UI/UX principles for a positive user interface experience to convey data in meaningful ways to analysts and decision makers.
• Strong proficiency in programming languages such as Python, Java, or other relevant languages for data processing and UI development.
• Experience in writing automation scripts for repetitive tasks (e.g., ingesting data, cleaning, etc.).
• Understanding of data structures, algorithms, and common data science techniques.
• Experience with data science tools like Pandas, NumPy, or similar libraries for data manipulation.
• Familiarity with cloud platforms (AWS, Azure, etc.) is a plus, especially if the data pipeline is running in the cloud.
• Understanding distributed systems principles.
• Experience in taking ideas and proofs of concepts to a minimal viable product.
• Experience is developing rapid prototypes to meet critical mission needs.

Responsibilities

• Help design and develop the core data platform and framework, enabling interoperability across high-impact federal systems.
• Create visualizations and dashboards in Kibana.
• Develop rapid prototypes to meet critical mission needs.

Preferred Qualifications

• 15+ years of experience working in data engineering or software development with a focus on data processing and user interface development. (Relevant Bachelors degree in science, math, information systems, or engineering can be substituted for up to two [2] years of experience only)
• Exposure to Elasticsearch/OpenSearch is a plus, but it’s not a dealbreaker if they have strong data engineering skills in other areas.
• Exposure to a UI framework like React.js is a must.
• Experience with rapid prototype creation and deployment is a must.
• Comfortable working under tight deadlines as necessary.