SME Software / Data Engineer

About this role

Overview

We are seeking an experienced Software & Data Engineer to support the maintenance, enhancement, and continued development of an existing social media data exploitation platform.

The program applies technical resources to accelerate the timely, reliable, and secure delivery of open-source data, information, and insights. The Software & Data Engineer will work within an established development team to enhance a service-based web application, develop data ingestion and processing capabilities, integrate external APIs, and maintain supporting database and infrastructure components.

What will you do?

Design, develop, enhance, and maintain software supporting a social media data exploitation platform.

Develop applications and services using Python.

Develop and maintain Python-based API integrations.

Design, develop, and integrate APIs utilizing: RESTful APIs

GraphQL

Sockets

Other web-service protocols

Develop and maintain software components using Java as required.

Develop enhancements to existing service-based web applications.

Work with web technologies including cookies, web transactions, host-to-host communication, browser developer tools, and mobile compatibility capabilities.

Utilize Anaconda and/or MicroMamba for Python environment and package management.

Maintain application source code within enterprise Git repositories.

Design, develop, and maintain SQL-based databases, including: PostgreSQL

MySQL

Develop and maintain PL/SQL scripts, including: Procedures

Functions

Exception handlers

Triggers

Write, optimize, and tune complex database queries.

Work with both structured and unstructured datasets.

Design and maintain Extract, Transform, and Load (ETL) processes.

Develop and support data ingestion and transformation pipelines.

Utilize Apache NiFi for data flow, ingestion, and processing.

Work with NoSQL and big-data technologies including: MongoDB

Elasticsearch

MapReduce

HBase

Troubleshoot database, ingestion, transformation, and data-processing issues.

Do you have what it takes?

Active TS/SCI with Polygraph Bachelor's degree in Computer Science, Information Technology, Engineering, or a related technical discipline preferred.

Demonstrated professional experience developing applications with Python.

Experience developing Python API integrations.

Experience utilizing Anaconda and/or MicroMamba for Python package and environment management.

Strong experience working within Linux environments.

Experience with Bash scripting, Cron jobs, and IT automation.

Experience developing and integrating APIs using REST, GraphQL, and/or socket-based communications.

Professional development experience with Java.

Experience with web application technologies and browser-based troubleshooting.

Knowledge of SSL/TLS, certificates, and secure application communications.

Experience designing, developing, and maintaining relational databases, including PostgreSQL and MySQL.

Experience developing PL/SQL scripts, procedures, functions, exception handlers, and triggers.

Experience developing and tuning complex queries against structured and unstructured datasets.

Experience maintaining Jenkins CI/CD pipelines with automated testing and deployment.

Experience with big-data and/or NoSQL technologies such as MongoDB, Elasticsearch, MapReduce, or HBase.

Experience with Apache NiFi.

Strong experience designing and supporting ETL processes and data pipelines.

Experience maintaining and troubleshooting software, hardware, and network infrastructure.

Experience using Git for source code management.

Strong troubleshooting, analytical, and problem-solving abilities.