Midas : A Machine Learning Model for Depth Estimation



Original Source Here

Overview

Midas is a machine learning model that estimates depth from an arbitrary input image.

Source: https://arxiv.org/pdf/1907.01341v3.pdf

Architecture

Various datasets containing depth information are not compatible in terms of scale and bias. This is due to the diversity of measuring tools, including stereo cameras, laser scanners, and light sensors. Midas introduces a new loss function that absorbs these diversities, thereby eliminating compatibility issues and allowing multiple data sets to be used for training simultaneously.

Midas uses multiple datasets for training, as shown in the table below. Therefore, it can estimate the depth of images in various conditions and environments.

Source: https://arxiv.org/pdf/1907.01341v3.pdf

In addition, 3D movies were also used for training to complement the existing data set.

Source: https://arxiv.org/pdf/1907.01341v3.pdf

Below is the loss function introduced by Midas.

Source: https://arxiv.org/pdf/1907.01341v3.pdf

The architecture of the network is based on ResNet.

Source: https://arxiv.org/pdf/1907.01341v3.pdf

Usage

You can use the following command to run Midas on the webcam video stream in ailia SDK.

$ python3 midas.py -v 0

You can also choose the higher precision v2.1 or the faster v2.1 small model, which runs five times faster than the regular model and enables real-time processing.

$ python3 midas.py -v 0 -v21
$ python3 midas.py -v 0 -v21 -t small

Here are some results.

AI/ML

Trending AI/ML Article Identified & Digested via Granola by Ramsey Elbasheer; a Machine-Driven RSS Bot



via WordPress https://ramseyelbasheer.io/2021/05/27/midas-a-machine-learning-model-for-depth-estimation/

Popular posts from this blog

Fully Explained DBScan Clustering Algorithm with Python

Image
Original Source Here Fully Explained DBScan Clustering Algorithm with Python Unsupervised learning in machine learning on density-based clusters Clustering In unsupervised Learning. A photo by Author In this article, we will discuss the machine learning clustering-based algorithm that is the DBScan cluster. The approach in this cluster algorithm is density-based than another distance-based approach. The other cluster which is distance-based looks for closeness in data points but also misclassifies if the point belongs to another class. So, density-based clustering is suited in this kind of scenario. The cluster algorithms come in unsupervised learning in which we don’t rely on target variables to make clusters. In a cluster, the main concern is on maximum dense connected points. The density-based clustering can be useful in arbitrary shapes even with noise. The working function of the density-based cluster is shown below: We select a random data point. Then it will ...
Read more

Hierarchical clustering explained

Image
Original Source Here Interpretation of dendrogram Each level of dendrogram has a subtle meaning to the relationship between its data members. In a regular relationship chart, one may interpret that at the top lies grandparents or the first generation, the next level corresponds to parents or second generation and the final level belongs to children or third generation. Likewise, in every branching procedure of dendrogram, all the data points having the membership at each level belongs to a certain class. However, to infer this class entity, one has to go through a few individual samples of each level within the formulated cluster and find out what feature is common in the resulting cluster. Also, these inferred classes need not be similar at the sister branches. For example, in level 2, the cats have been clustered on big ears and calm behavior but dogs have been clustered on a similar attribute of size. Inferred classes of data in dendrogram by the user (Image by Author) C...
Read more

Streamlit — Deploy your app in just a few minutes

Image
Original Source Here Streamlit is an open-source Python library that makes it easy to create and share beautiful, custom web apps for machine learning and data… Continue reading on Medium » AI/ML Trending AI/ML Article Identified & Digested via Granola by Ramsey Elbasheer; a Machine-Driven RSS Bot via WordPress https://ramseyelbasheer.io/2021/07/11/streamlit%e2%80%8a-%e2%80%8adeploy-your-app-in-just-a-few-minutes/
Read more