The IoT Engineer II (Big Data Developer) supports the development of scalable and resilient big data platforms for Cerebrum IoT. The role focuses on building, optimizing, and maintaining big data pipelines and architectures to enable rapid development and deployment of high-impact services within IoT environments.
Key Responsibilities
- Define architecture, scope, and deliver robust Big Data solutions.
- Build scalable data pipelines for ingesting and processing large datasets.
- Identify critical data elements and define data quality rules.
- Utilize Spark/Hadoop ecosystem to design and enhance data capabilities.
- Contribute to improvements in Data Governance and large-scale data processing best practices.
- Conduct bug fixing, performance tuning, and data pipeline optimization.
- Collaborate with and mentor team members to foster technical growth.
- Ensure compliance with company policies, regulatory standards, and quality guidelines.
- Support departmental KPIs and team development initiatives (if in a managerial capacity).
Requirements
- Bachelor's degree in Computer Science, IT, or a related field.
- 5+ years as a Big Data Engineer or Software Engineer.
- Strong experience with at least one programming language (preferably Scala).
- 4+ years working with MongoDB or other NoSQL databases.
- Experience with real-time data processing technologies such as Kafka or Spark Streaming.
- Familiarity with Hive, Presto, Python, or Java is a plus.
- Strong analytical and programming skills.
- Proficiency in big data architecture and tools.
- Effective communication and collaboration skills.
- English language proficiency.
الإبلاغ عن وظيفة
