We are looking for a Nifi / HDF Admin to assist our customer with managing their Nifi Cluster. This initial engagement will last 2 months and if the resource performs well, they will be extended for up to 1 year. The initial 2 months allows for weekly T&E, but longer term, we hope the resource will relocate to Charlotte.
The start date is ASAP, but we can wait 1-2 weeks for the right resource.
Job Description:
HDF Install/Admin tasks, will be sufficient for now. If they have broader Nifi skills, they will stay through the rest of the year doing:
Build NiFi flow accessing historical Pi tag data via HTTP:
Parse JSON response, push to HDFS.
Includes time for integrating with new Pi HTTP endpoint
Create configuration file format allowing specification of:
Pi server, tag name, time window on a per tag basis
Include optional config for remapped Pi server name:
Historical data may reside in 'TEST' but replace 'TEST' with given original Pi server name
Implement NiFi Reporting Task:
Poll Pi Server health metrics
Schedules/throttles requests to keep impact on Pi health below acceptable threshold
NiFi reporting task must log all requests to Pi, including:
Timestamp, tag and window requested
Current Pi health metrics indicating 'safe' conditions for issuing request
Import processes span multiple days:
Reporting task must periodically log 'state' of import on tag basis:
For each tag, what range of window has been successfully imported thus far.