Manifold Blog

Manifold Blog

Applications of Matrix Decompositions for Machine Learning

Posted by Prince Grover on Jul 25, 2018 9:00:00 AM

Motivation

In machine learning and statistics, we often have to deal with structural data, which is generally represented as a table of rows and columns, or a matrix. A lot of problems in machine learning can be solved using matrix algebra and vector calculus. In this blog, I’m going to discuss a few problems that can be solved using matrix decomposition techniques. I’m also going to talk about which particular decomposition techniques have been shown to work better for a number of ML problems.

Read More

Topics: Data science

Torus: A Python Toolkit for Docker-First Data Science

Posted by Alexander Ng on Apr 19, 2018 7:00:00 AM

As interest in Artificial Intelligence (AI), and specifically Machine Learning (ML), grows and more engineers enter this popular field, the lack of de facto standards and frameworks for how work should be done is becoming more apparent. A new focus on optimizing the ML delivery pipeline is starting to gain momentum.

Read More

Topics: MachOps, Torus, Data engineering

Distance Matrix Vectorization Trick

Posted by Sourav Dey on Aug 15, 2016 7:00:00 AM

A common problem that comes up in machine learning is needing to find the l2-distance between two sets of vectors. For example, in implementing the k-nearest-neighbors algorithm, we have to find the l2-distance between the a set of test vectors, held in a matrix X (MxD), and a set of training vectors, held in a matrix X_train (NxD). Our goal is to create a distance matrix D (MxN) that contains the l2-distance from every test vector to every training vector. How can we do this efficiently?

Read More

Topics: Data science

Sensor Edge Finding at Cortex

Posted by Sourav Dey on Feb 22, 2016 9:00:00 AM

This article is Part 2 of a three-part series that we are writing about work that Manifold did with one of our clients, Cortex Building Intelligence. In our previous post, we talked about finding edges in sensor signals so we could use them to help us estimate a building’s start time.

We want to find sharp transitions in the various HVAC sensors—rising edges for electricity, steam, and static pressure and falling edges for supply air temperature (SAT). It’s easy for a human to pick out edges—but how do we teach a computer to do it?

Read More

Topics: Signal processing, AI at the edge, Data science

Data Science at Cortex

Posted by Sourav Dey on Feb 17, 2016 9:00:00 AM

This article is Part 1 of a three-part series that we are writing about work Manifold did with one of our clients, Cortex Building Intelligence. Cortex’s vision is to use data-science to make commercial building heating, ventilation, and air conditioning (HVAC) operations more efficient.

Over the next few posts, we want to give you a look "under the hood” of our data-science operations. To that end, we’ll discuss how we solved one of the foundational problems at Cortex: figuring out when a building’s HVAC systems were turned on.

Read More

Topics: Signal processing, AI at the edge, Data science

Never Miss a Post

Get the Manifold Blog in Your Inbox

We publish occasional blog posts about our client work, open source projects, and conference experiences. We focus on industry insights and practical takeaways to help you accelerate your data roadmap and create business value.


Subscribe Here


Recent Posts