Visualize Amazon Lookout for Vision Inference with Amazon QuickSight



Original Source Here

For production purposes, you may want to leverage AWS IoT Greengrass to manage numerous IoT devices detecting anomalies with Amazon Lookout for Vision. You may also want to upload the pictures taken from the device camera to an Amazon S3 bucket for human-in-the-loop validations and model retraining.

The Work

Hardware Setup

I must admit that this was my first ever interaction with Raspberry Pi, and was super surprised with how it worked. I bought a Raspberry Pi Zero W starter kit, a 32GB microSD card, and camera from Amazon and followed the setup instructions on the Raspberry Pi website:

Once the camera setup was completed, my Raspberry Pi Zero W was ready to be operational. Hence, moved to setting up access to AWS resources.

AWS Setup

I created an AWS user account with CLI access only for my device with only the required policies based on the resources that would be accessed by the device, which are permission detect anomalies with Amazon Lookout for Vision and permission to publish to an Amazon Kinesis Data Firehose Delivery Stream.

{
    "Version": "2012-10-17",
    "Statement": [
        {
            "Effect": "Allow",
            "Action": [
                "lookoutvision:DetectAnomalies"
            ],
            "Resource": "<my-model-arn-here>"
        },{
            "Effect": "Allow",
            "Action": [
                "firehose:PutRecord",
                "firehose:PutRecordBatch"
            ],
            "Resource": "<my-firehose-deliverystream-arn-here>"
        }    
    ]
}

Once this was completed, I created a simple code snippet following the recipes available in the Picamera documentation.

Detect Anomalies with Amazon Lookout for Vision

The gist below contains a Python script detects anomalies with Amazon Lookout for Vision based on images captured from the Raspberry Pi camera and publishes the detection to an Amazon Kinesis Data Firehose Delivery Stream.

Explore with Amazon Athena, visualize with Amazon QuickSight

With inference information now arriving in our Amazon S3 data lake, we can setup an AWS Glue Crawler to automatically detect the schema of the data and create table in AWS Glue Data Catalog, queryable via Amazon Athena. I can run SQL queries via the Amazon Athena console, or using QueryPal, an open source web and mobile UI for Amazon Athena.

Furthermore, I can create a dashboard in Amazon QuickSight based on tables in Amazon Athena. And with the newly launched Amazon QuickSight Q, I can interact with the data in natural language queries e.g. “Show me anomalies detected in plant XYZ in the last 3 weeks” — imagine the possibilities.

Near Future Work

We have put a lot of work into developing this solution and we strongly believe that not everyone should be involved in undifferentiated heavy-lifting, unless you really want to hack this together. Therefore, we are actively working on making this available as a managed service. Kindly drop a comment if you’re interested in a live demo.

AI/ML

Trending AI/ML Article Identified & Digested via Granola by Ramsey Elbasheer; a Machine-Driven RSS Bot



via WordPress https://ramseyelbasheer.io/2021/03/13/visualize-amazon-lookout-for-vision-inference-with-amazon-quicksight/

Popular posts from this blog

I’m Sorry! Evernote Has A New ‘Home’ Now

Image
Original Source Here My Apologies! I was critical about the grandfather of all apps — Evernote a few months back when I wrote Why is Evernote losing its Ground? on Medium. With that said, I also wrote another story on Evernote in November of last year — Has Evernote Made A Comeback After Years Of Stagnation? This was the time when Ian Small and his team were making inroads into the technology and strategically making enhancements and revamping the app across all platforms. Evernote Is At A War-front And Wants To Prove A Point. I must h ave written this in my earlier blogs but just to re-iterate — I have been and am an avid user of Evernote since 2009 and is a part of my life for planning my daily life, projects, content writing, and almost everything. Recently, Evernote has launched its HOME or you may call it a DASHBOARD that provides its users a one-stop place to get access to their important and critical notes and also provides a few AI-enabled capabilities that I wil...
Read more

Jensen Huang: Racism is one flywheel we must stop

Image
https://venturebeat.com/wp-content/uploads/2021/07/jensen-huang.jpg?w=1200&strip=all Original Source Here All the sessions from Transform 2021 are available on-demand now. Watch now. Jensen Huang , CEO of Nvidia , received the distinguished lifetime achievement award by the Asian American Engineer of the Year from the Chinese Institute of Engineers (CIE) group. And in his acceptance speech, he made a rare comment beyond Nvidia’s business matters: “Racism is one flywheel we must stop.” The comments came at the end of an acceptance speech where he thanked the group for its award, an annual gathering that recognizes outstanding Asian American scientists, engineers and role models. In a virtual ceremony, Huang was awarded for his contributions as “a visionary and innovator in parallel computing technology that accelerates the realization of AI computing.” He also spoke of his experience as an immigrant and an Asian American. “It is strange to accept a lifetime achievem...
Read more

Streamlit — Deploy your app in just a few minutes

Image
Original Source Here Streamlit is an open-source Python library that makes it easy to create and share beautiful, custom web apps for machine learning and data… Continue reading on Medium » AI/ML Trending AI/ML Article Identified & Digested via Granola by Ramsey Elbasheer; a Machine-Driven RSS Bot via WordPress https://ramseyelbasheer.io/2021/07/11/streamlit%e2%80%8a-%e2%80%8adeploy-your-app-in-just-a-few-minutes/
Read more