About

Scale Unlimited is based in Nevada City, California and provides consulting and training services for big data analytics, search, and web mining.

The company was founded in 2008 by Stefan Groschupf, Chris Wensel, and Ken Krugler, three of the world’s leading experts in scalable, reliable data analytics, workflow design and web mining.

All are well-known community members and contributors to key open source projects, including Apache Hadoop®, Cascading, Apache Solr™, Apache Lucene®, Bixo and Apache Tika™.

Solutions from Scale Unlimited are built using these and other widely used and well supported open source packages, providing maximum flexibility with no commercial lock-in.

Inspiration

Scale Unlimited solves two major problems that the founders experienced first-hand at previous startups and consulting projects.

First, processing big data requires workflow systems that are efficient, reliable and scalable. Even a small dataset is often gigabytes of data. A workflow based on ad hoc scripts isn’t reliable. Single server solutions don’t scale.

With Scale Unlimited, solutions are built using Apache Hadoop, Apache Flink and Cascading-based workflows.

Second, having an internal team ready and able to assume responsibility is critical for the long-term success of the project. A consulting project without a hand-off plan is destined to fail.

We provide introductory and advanced training on the open source technologies we use, including Apache Hadoop, Apache Flink, Cascading and Apache Solr. And we know how to mentor your team, ensuring a smooth and successful hand-off at the end of the project.

Team

kkrugler-headshot Ken Krugler – Veteran developer and entrepreneur, 25+ years experience. Founder and President of TransPac Software, a 20 year leader in internationalization, mobile devices, and search consulting. Founder and CTO of Krugle, a vertical search engine and enterprise appliance for code and technical information (funded by Emergence Capital). Co-founder of Bixo web mining project. Author and speaker on vertical search and web mining.

Chris Schneider – VP of TransPac Software. Technical lead on Krugle vertical web crawler. BS in Computer Science from MIT, MS in Education from UC Berkeley.

Vivek Magotra – Technical lead on Krugle web crawler page classifier. Part of team that developed large scale Hadoop-based data processing system. BS & MS in Computer Science from University of Pune.