Lead Data Engineer

At 8x8 Inc. [Nasdaq:EGHT] we put communications at the heart of our business and build technology that allows people to connect anytime, anywhere they are in the world, and on any device. XCaaS - the 8x8 Experience Communications Platform - brings together Employee and Customer Experience, enabling hybrid workforces across the globe to connect, collaborate, and delight customers, while providing businesses with real-time communications analytics, intelligence and unique insights.

Learn more on our company website at www.8x8.com follow our pages on LinkedIn, Twitter, Facebook and Instagram.

As a Lead Data Engineer, you will be responsible for architecting, designing, and implementing robust data solutions to drive analytics and business intelligence initiatives. You will lead a team of data engineers to develop and maintain data pipelines, data architectures, and data management processes that ensure high quality and availability of data across the organization.

Key Responsibilities:

Data Pipeline Development:

• Design, build, and maintain efficient and reliable ETL (Extract, Transform, Load) processes to collect, integrate, and prepare data from various sources.

• Develop scalable and high-performance data pipelines that support data ingestion, processing, and retrieval.

Data Architecture Design:

• Collaborate with stakeholders and data architects to define and implement data architecture strategies and best practices.

• Evaluate and select appropriate tools and technologies to enhance data processing capabilities, including databases, data lakes, and big data solutions.

Team Leadership:

• Lead a team of data engineers, providing mentorship, guidance, and support to enhance their skills and performance.

• Foster a culture of collaboration, innovation, and continuous improvement within the data engineering team.

Data Quality Assurance:

• Establish and enforce data quality standards, validation rules, and data governance practices to ensure data integrity and reliability.

• Monitor data pipelines for performance and accuracy, resolving issues as they arise.

Collaboration with Cross-Functional Teams:

• Work closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions that meet their needs.

• Facilitate discussions to gather feedback on data solutions and refine processes accordingly.

Performance Optimization:

• Analyze and optimize existing data pipelines and databases for performance, scalability, and cost-effectiveness.

• Develop strategies to improve data processing efficiency, including partitioning, indexing, and tuning queries.

Documentation and Best Practices:

• Maintain comprehensive documentation of data architectures, data flows, and standard operating procedures.

• Promote best practices in data engineering, including coding standards, version control, and testing methodologies.

Stay Updated with Industry Trends:

• Keep abreast of emerging technologies, trends, and best practices in data engineering and analytics.

• Continuously evaluate and recommend new tools and frameworks to enhance the data engineering capabilities of the organization.

Qualifications:

• Bachelor’s or Master’s degree in Computer Science, Data Science, Engineering, or a related field.

• 5+ years of experience in data engineering or related roles, with a focus on building and maintaining data pipelines.

• Proficiency in programming languages such as Python, and experience with data processing frameworks 

• Strong knowledge of SQL and experience with relational databases (e.g., PostgreSQL, MySQL), as well as Snowflake.

• Experience with ETL processes and tools (e.g., Matillion).

• Familiarity with cloud-based data solutions (e.g., AWS, Azure, OCI) and big data technologies (e.g., Apache Kafka, Apache Spark) is a plus.

• Familiarity with search technologies (e.g., ElasticSearch) and data governance, data quality, and data security best practices.

• Excellent problem-solving skills, attention to detail, and a proactive approach.

• Strong communication skills with the ability to collaborate effectively with both technical and non-technical stakeholders.

For a closer look into what life at 8x8 UK Ltd. is about check out our Instagram page.
8x8 believes diversity makes our company stronger which is why we are a proud equal opportunities employer and encourage all of our staff to bring their authentic selves to work. We believe in fairness which is why we have been a member of the Living Wage Foundation for many years and we believe in security so reserve the right to undertake background checks on anyone that we extend an employment offer to.

Our Job Applicant Privacy Notice can be found here.