Apache Nifi Developer
Our client is seeking a skilled Developer to support a public sector project requiring hands on skill with Apache Nifi and related data integration tools.
Duties
To gather requirement, to design , development and production roll out and support for above mentioned initiative.
Qualifications
A senior NiFi developer should have a robust skillset to design, develop, and maintain complex data integration workflows using Apache NiFi. Below is a comprehensive list of key skills and expertise required:
Technical Skills
o Expertise in Apache NiFi
• Deep understanding of NiFi architecture, components (processors, controller services, flowfiles, etc.), and dataflow concepts.
• Proficiency in creating, managing, and optimizing NiFi dataflows for high-throughput, low-latency data processing.
• Familiarity with NiFi Expression Language for dynamic configuration and routing.
o Data Integration and ETL
• Strong experience in designing and implementing ETL (Extract, Transform, Load) pipelines.
• Ability to integrate diverse data sources (databases, APIs, file systems, message queues, etc.) and sinks.
• Understanding of data formats (JSON, XML, CSV, Avro, Parquet, etc.) and schema management.
o Programming and Scripting
• Proficiency in Java, Groovy, Python for automation and custom logic.
• Familiarity with REST API integration for interacting with NiFi’s API for automation and monitoring.
o Big Data Ecosystem
• Knowledge of integration with big data tools like Hadoop, Kafka, Spark, Hive, or HBase.
• Experience with message brokers (e.g., Kafka, RabbitMQ) for real-time data streaming.
• Understanding of cloud-based data platforms (AWS, Azure, Google Cloud) and their integration with NiFi.
o Database and Storage Systems
• Proficiency in working with relational databases (e.g., MySQL, PostgreSQL, Oracle) and NoSQL databases (e.g., MongoDB, Cassandra).
• Familiarity with cloud storage solutions (e.g., S3, Azure Data Lake, Google Cloud Storage).
• Knowledge of SQL for querying and transforming data.
o DevOps and CI/CD
• Experience with containerization (Docker, Kubernetes) for deploying NiFi in modern environments.
• Familiarity with CI/CD pipelines (Jenkins, GitLab CI, etc.) for automating NiFi flow deployments.
• Knowledge of infrastructure as code (IaC) tools like Terraform or Ansible for environment setup.
o Monitoring and Performance Tuning
• Expertise in monitoring NiFi performance using tools like NiFi’s built-in monitoring, Grafana, or Prometheus.
• Ability to optimize dataflows for performance, scalability, and resource efficiency.
• Experience with logging, debugging, and troubleshooting NiFi issues.
o Security
• Understanding of NiFi security features, including SSL/TLS, authentication (LDAP, Kerberos, OAuth), and authorization (role-based access control).
• Knowledge of data encryption, secure data transfer, and compliance with standards like GDPR or HIPAA.
Soft Skills
o Problem-Solving
• Ability to analyze complex data integration challenges and design efficient solutions.
• Strong debugging and troubleshooting skills to resolve pipeline issues.
o Collaboration and Communication
• Experience working with cross-functional teams (data engineers, analysts, DevOps, etc.).
• Ability to document dataflows and communicate technical concepts to non-technical stakeholders.
o Leadership and Mentorship
• Ability to guide junior developers, review code, and enforce best practices. • Experience leading NiFi-based projects or initiatives.
Domain Knowledge
o Data Engineering Best Practices
• Understanding of data governance, lineage, and metadata management.
• Familiarity with data quality frameworks and ensuring data integrity in pipelines.
o Industry-Specific Knowledge
• Depending on the organization, knowledge of industry-specific data standards is a plus.
Tools and Platforms
o Version Control: Git, GitHub, GitLab, etc.
o Cloud Platforms: AWS (S3, Redshift, Lambda), Azure (Data Factory, Blob Storage), Google Cloud (BigQuery, Cloud Storage).
o Monitoring Tools: Prometheus, Grafana, ELK Stack.
o Testing: Unit testing frameworks and integration testing for dataflows.
Experience Level
o 5+ years of experience working with Apache NiFi. o Hands-on experience with large-scale, production-grade NiFi deployments.
o Proven track record of delivering complex data integration projects.
A senior NiFi developer should combine deep technical expertise with practical experience in building scalable, secure, and efficient data pipelines while staying adaptable to evolving technologies and business needs.
Deliverables:
Validate and update requirement document, to design , development and production roll out and support for above mentioned initiative.
The pay range that the employer reasonably expects to pay for this position is between CA$85.00 and CA$95.00
Our voluntary benefits offering includes medical, dental, vision and retirement benefits.
Applications will be accepted on an ongoing basis.
Tundra Technical Solutions would like to thank you for the interest you have demonstrated in this opportunity. However, only candidates with the required skills will be contacted.
Tundra Technical Solutions is an Equal Opportunity/Affirmative Action Employer. We welcome and encourage diversity in our workplace.
Not interested in this position, but know somebody who might be? Check out our Referral Reward Program, referrals are a big secret behind our success. As always, we’re on the lookout for great people. And we know that you know great people!
Tundra Technical Solutions is among North America’s leading providers of Information Technology and Engineering staffing and consulting services. Our success and our clients’ success are built on a foundation of service excellence. Rather than continually trying to sell to new clients and companies and simply filling databases with candidates, we focus on developing stronger relationships and deeper knowledge of our existing clients’ challenges and opportunities.
Open ears. Open minds. Open futures