Architect - Machine Learning at Splunk
San Francisco, California, United States
🇺🇸 (Posted Jun 5 2018)
About the company
Splunk Inc. (NASDAQ: SPLK) was founded to pursue a disruptive new vision: make machine data accessible, usable and valuable to everyone. Machine data is one of the fastest growing and most valuable parts of big data -- generated by every component of IT infrastructures, applications, mobile devices, website clickstreams, social data, sensors and more. Splunk is the leading software platform for machine data that enables customers to gain real-time Operational Intelligence. Our company's mission is to address the challenges and opportunities of managing massive streams of machine-generated big data. More than three quarters of the Fortune 100 and thousands of enterprises, universities, government agencies and service providers use Splunk software to harness the power of their machine data for application management, IT operations, security, web intelligence, customer and business analytics and more. Splunk helps customers solve problems in ways they could never dream before. With Splunk, all you need is a browser and your imagination.
At Splunk, we invest heavily in innovation, and we’re passionate about helping customers build solutions leveraging state-of-the-art AI/ML/DL tools on the Splunk Platform. We’re currently seeking a Machine Learning Software Architect to drive architectural efficiency of all engineering deliverables and ensure alignment with Splunk’s overall architecture and technology strategy.
This is a highly visible role focused on driving development process excellence while ensuring extraordinary system scalability, performance, and extensibility. The variety and amount of data we process is unprecedented.
The ideal candidate will have experience evaluating multiple complex technical solutions in the machine learning area and clearly communicate to a distributed, cross-functional team the relative merits and concepts. You have a pragmatic, customer-focused approach to architecture, design, and development, and will set technical direction for a new platform of solutions. You have significant experience in applying machine learning concepts to a variety of technical areas. You have experience with supervised, unsupervised, and reinforcement learning, and have developed, deployed, and supported applications utilizing these capabilities in Scala/Java, Python and/or C/C++.
About the role:
You will work directly with Splunk’s VP Engineering and machine learning pioneer Toufic Boubez
You will drive architectural design decisions for Splunk focusing on machine learning while considering the long-term effectiveness and interoperability and be responsible for seeing those decisions implemented successfully
Innovate product architecture while maintaining the integrity of existing products and observing maintenance constraints
Drive discussions around product content, working closely with Product Management to define product strategy and roadmap
Drive prototyping and proof of concept development activities
Analyze data sets for utility in unsupervised and supervised learning activities, perform failure analysis and feature engineering to improve performance & communicate these findings in a clear and thoughtful manner
Leads team and influences other teams in understanding and appropriately utilizing machine learning techniques into traditional software development
Lead software system architecture and design to appropriately incorporate machine learning into product features and can effectively communicate this solution to software engineers and business leaders
Plan, architect, design, develop, test and maintain key software improvements, primarily related to machine learning capabilities
Skills & requirements
5+ years experience using machine learning tools and libraries such as scikit-learn, tensorflow, Jupyter, pandas, statsmodel, MLlib (Spark), R, KNIME, etc.
Experience with big data analytics and visualization products (Splunk, MongoDB, Hadoop, ElasticSearch, Spark, Tableau, etc.)
Experience building and deploying services on the Cloud (AWS, Azure, Google cloud) is a huge plus
Strong leadership competencies including the ability to foster the strategy, drive an inspiring culture, build trust and deliver customer-centric innovation
15+ years of software and product development experience with at least 5 years in a comparable technical leadership position
10+ years practical experience developing large-scale production systems in Scala, Java, Python and or C/C++
Exposure to a wide variety of enterprise software, cloud service, and application technologies
Proven ability to drive innovation from incubation to product using modern software development practices and tools
Masters, Ph.D. or foreign equivalent in Computer Science, Engineering, or a related field