Figuring out when something has gone wrong with your app or site is extremely difficult. Anomaly detection was a major theme among speakers this year at Monitorama, an open source monitoring conference. You can create trends based on historical data means trends, and those trends can be extrapolated into predictions of traffic patterns. When live traffic deviates from the prediction, you can try to detect if it is a true anomaly or not.
One of the hardest problems in anomaly detection systems is trying to avoid false positives — you don’t want to be woken up at 2 a.m. to fix a problem when nothing is actually broken in the product. This often leads to a phenomenon called “alert fatigue” where the on-call developer ignores noisy notifications, allowing for real events to sneak through undetected.
At Tagged, we embrace open source as part of our engineering culture, always looking for ways to best support our own products while also sharing what we learn with the outside world.
Now, as we shift to a smartphone-oriented world, Tagged pivots its strategy to focus more on native mobile platforms. With this focus in mind, we are happy to introduce two of Tagged’s latest contributions to the open-source community: iOS-cat-scroller and iOS-voting-stack. Continue Reading
Brickhouse is a library of user-defined functions for Hive and Hadoop that enables the agile development of big data pipelines. It provides tools and techniques that allow those pipelines to process larger datasets more robustly. The Brickhouse project was developed at Klout, whose team will continue to use and build upon Brickhouse and hosts the github repo. Since I’ve recently joined the Tagged team and am the the primary maintainer of Brickhouse, we’re going to start using it at Tagged as well.
Open source is the future. Tech companies no longer benefit by hoarding their technology; more and more, the tech community has realized the power of information-sharing and open collaboration for the advancement of the industry.
Tagged is one such company, exploring and investing in many different technologies that focus on how people meet new people and the science of human connection. As one of Tagged’s Open Source Advisors, I was pleased to introduce them to another innovative startup, Numenta, that supports machine learning and machine intelligence through research of the human cortex. These two tech powerhouses recently came together to host the second NuPIC (Numenta Platform for Intelligent Computing) Hackathon at Tagged HQ.
The event provided a great opportunity for tech minds from all corners of the machine learning world to discuss new ideas and explore interesting projects in the vein of Social Discovery. Hackathons, in particular, are the best way to get folks prototyping applications and socializing over mutual passions.
From engineers to entrepreneurs to neuroscientists, there was no lack of creativity present. One team was developing software to control a quad-copter with the Cortical Learning Algorithm (a key part of NuPIC), while another worked on Neuro-Linguistic Programming (NLP) and attempting to teach NuPIC the natural language. Another group was coaching a small robot by feeding input through the Cortical Learning Algorithm — all fantastic projects!
NuPIC hackers at work!
Thanks to everyone who participated in the NuPIC Hackathon, and I look forward to seeing more advances in this cutting-edge field of machine learning.
Check out more photos of the event on Flickr.
Danese Cooper has been an advocate of open source software and the development and evangelization of the broader Open Source movement and its methodologies since 1999. Danese is an Open Source Advisor to Tagged.
Today is a great day for the open source community. At Tagged we leverage a good deal of open source technologies to scale tagged.com and bring the best possible experience to our users. Today we are giving back to the community that has helped us in numerous ways by opening our Digsby source code to everyone. (Digsby, an application for IM, email and social network management, was brought under the Tagged brand last year.)
Over the past few months we have been working to bring Digsby into a more open-source friendly state. Our main goals were to make it easy to set up and develop. Furthermore, we wanted to sunset the Digsby servers as numerous services exist on the Internet that are more widely used and have very extensive APIs to accomplish the same synchronized experience.
We first started by removing the client’s dependency on our servers, but we also wanted to preserve all existing accounts for existing users. To do this properly we included a profile importer in the local account creation workflow to help ease the transitions of local accounts for our current users.
Next we wanted to make sure that we could set up a consistent environment for all developers. We tweaked our build process and made sure that everyone could build Digsby and all of its dependencies. This will allow a more powerful experience by letting anyone tinker with the building blocks of wxWidgets, WebKit and some of the other dependencies for Digsby.
We will be hosting Digsby on GitHub for anyone to access. From this point forward we will be building Digsby together, so your input will directly contribute to the future of Digsby!
Check out photos of the Digsby team and milestones on Flickr.
Jeffrey Rogiers was an original member of the Digsby team. He is now working on the Tagged mobile team as an Engineering Manager. You can follow him on Twitter.