Data Engineer
As a Data Engineer, you should be an expert with data warehousing technical components (e.g., ETL, ELT, Cloud Databases and Reporting), infrastructure (e.g. hardware and software) and their integration. You should have a deep understanding of the architecture for enterprise-level data lake solutions using multiple platforms (RDBMS, AWS, Cloud). You should be an expert in the design, creation, management, and business use of extremely large datasets. You should have excellent business and communication skills to be able to work with business owners to develop and define key business questions, and to build data sets that answer those questions. The individual is expected to be able to build efficient, flexible, extensible, and scalable ETL and reporting solutions.
What you'll do: Yeah, I want to and can do that.
- As a Data Engineer, you will be responsible for engineering data pipelines for Splunk’s enterprise data platform, democratizing datasets, enabling advanced analytics capabilities, integrating data from various systems, and applications. You will work as part of an evolving Enterprise Data Management(EDM) - Data Engineering Team to rapidly design, secure, build, test and release new data enablement capabilities. The role will collaborate closely with other specialists, Product Managers & key stakeholders across the company.
- Build large-scale batch and real-time data pipelines using the cloud data technologies, such as Snowflake, Matillion, Kubernetes, Python, Apache Airflow and Apache Kafka
- Serve as a resource for data management implementations on other technology teams and collaborate with data owners, business owners, and leaders.
- Supports the design and development of framework based data integration and interoperability across multiple Splunk Business applications.
- Advanced level skills in Python, SQL, data integration, data modeling and data architecture.
Requirements: I’ve already done that or have that!
- A minimum of 5 years of related experience
- 3+ years of experience as a Data Warehouse Architect or Data Engineer.
- 2+ years of experience driving adoption and building automation of data management services and tools.
- 2+ years of experience with API based ELT automation framework, data management, or interface design, development and maintenance.
- Large scale design, implementation and operations of Cloud data storage technologies such as AWS Redshift, Snowflake, Kubernetes, etc.
- 3+ years of experience with programming scripting and data science languages such as Python, SQL, etc.
- Experience in building data models, including conceptual, logical, and physical for Enterprise Relational, and Dimensional Databases.
- Advanced knowledge of Big Data concepts in organizing both structured and unstructured data
Preferred knowledge and experience: These are a huge plus.
- Knowledge of Splunk products
- Knowledge of DBT
- Experience with Sales Operations, Partner Operations and customer success business processes and applications
Education: Got it!
- Bachelor’s degree preferably in Computer Science, Information Technology, Management Information Systems, or equivalent years of industry experience.
We value diversity, equity, and inclusion at Splunk and are an equal employment opportunity employer. Qualified applicants receive consideration for employment without regard to race, religion, color, national origin, ancestry, sex, gender, gender identity, gender expression, sexual orientation, marital status, age, physical or mental disability or medical condition, genetic information, veteran status, or any other consideration made unlawful by federal, state, or local laws. We consider qualified applicants with criminal histories, consistent with legal requirements.
This is a test line.
About Splunk
Splunk was founded to pursue a disruptive new vision: make machine data accessible, usable and valuable to everyone. Machine data is one of the fastest growing and most complex areas of big data—generated by every component of IT infrastructures, applications, mobile phone location data, website clickstreams, social data, sensors, RFID and much more.
Splunk is focused specifically on the challenges and opportunity of taking massive amounts of machine data, and providing powerful insights from that data. IT insights. Security insights. Business insights. It’s what we call Operational Intelligence.
Since shipping its software in 2006, Splunk now has over 13,000 customers in more than 110 countries around the world. These organizations are using Splunk to harness the power of their machine data to deepen business and customer understanding, mitigate cybersecurity risk, prevent fraud, improve service performance and reduce costs. Innovation is in our DNA – from technology to the way we do business. Splunk is the platform for Operational Intelligence!
Splunk has more than 2,700 global employees, with headquarters in San Francisco, an office in San Jose, CA and regional headquarters in London and Hong Kong.
We’ve built a phenomenal foundation for success with a proven leadership team, highly passionate employees and unique patented software. We invite you to help us continue our drive to define a new industry and become part of an innovative, and disruptive software company.
Benefits & Perks: Wow! This is really cool!
SF Only
Medical, full company paid Dental, Vision and Life Insurance, Flexible Spending and Dependent Care Accounts, Commuter Accounts, Employee Stock Purchase Plan (ESPP), 401(k), 3 weeks of PTO, sick leave, stocked micro kitchens in Splunk offices, catered lunches on Mondays, catered breakfast on Fridays, basketball hoops, ping pong, arcade games, BBQ’s, soccer, “Fun Fridays”.
Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
Non SF
Medical, full company paid Dental, Vision and Life Insurance, Flexible Spending and Dependent Care Accounts, Commuter Accounts, Employee Stock Purchase Plan (ESPP), 401(k), 3 weeks of PTO and sick leave. Our work environments vary by location however we believe in hosting amenities and fun activities to fuel our energy. You may find fully stocked micro kitchens, catered lunches on Mondays and breakfast on Fridays, basketball hoops, ping pong, arcade games, BBQ’s, soccer and “Fun Fridays”.
This isn’t a job – it’s a life changer – are you ready?
Individuals seeking employment at Splunk are considered without regards to race, religion, color, national origin, ancestry, sex, gender, gender identity, gender expression, sexual orientation, marital status, age, physical or mental disability or medical condition (except where physical fitness is a valid occupational qualification), genetic information, veteran status, or any other consideration made unlawful by federal, state or local laws. Click here to review the US Department of Labor’s EEO is The Law notice. Please click here to review Splunk’s Affirmative Action Policy Statement.
Splunk does not discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. Please click here to review Splunk’s Pay Transparency Nondiscrimination Provision.
Splunk is also committed to providing access to all individuals who are seeking information from our website. Any individual using assistive technology (such as a screen reader, Braille reader, etc.) who experiences difficulty accessing information on any part of Splunk’s website should send comments to [email protected]. Please include the nature of the accessibility problem and your e-mail or contact address. If the accessibility problem involves a particular page, the message should include the URL of that page.Splunk doesn't accept unsolicited agency resumes and won't pay fees to any third-party agency or firm that doesn't have a signed agreement with Splunk.
To check on your application click here.