Saying “Hello, old friend” to Statistics and Analytics

There’s a reason I chose Statistics to be no. 10 and the first one in this countdown. When you want to enter the world of data science, you realize very quickly that you can do nothing without the concepts of statistics being clear in your head. The University of Texas at Dallas obviously understood this and made Statistics and Analytics a core course. So, when I started my Master’s program in Fall 2018, I enrolled for this course with Dr. Avanti Sethi in my very first semester. Dr. Sethi proved to be an excellent teacher, and I am honored to have had the pleasure of knowing and working with him during the past two years.

Photo by Luke Chesser on Unsplash

Thanks to his well-designed lectures and assignments, I was able to build a strong statistical foundation with good practice of basic concepts like measures of central tendency (mean, median, mode) and measures of statistical dispersion (variance, standard deviation, IQR). The course then went on to cover concepts like population, sampling, estimation, z-score, t-score, Normal distribution, hypothesis testing, p-value, chi-square tests, ANOVA tests and regression. Dr. Sethi, who is an Excel ninja, also conducted a separate hands-on session for students interested in learning Advanced Excel and taught us how to build macros. The problem statements in his assignments covered real-life scenarios ranging from sports team performances and automobile dealerships to Halloween sales and manufacturing plant obstacles.

Dr. Sethi’s class in Sep 2018

And just like that, right in the very first semester, Statistics and Analytics had set the ball rolling on my data science journey. I have been going back to Dr. Sethi’s assignments every few months, to make sure I don’t forget the very foundations of everything that I have learned in analytics so far. It was a memorable semester thanks to this wonderful class, and left me with a lot of confidence to move forward.

This is the first post of my #10DaysToGraduate series where I share 10 key lessons from my Master’s degree in the form of a countdown to May 8, my graduation date.

AWS Certified Solutions Architect Associate – My First Technical Certification

A few months ago when I Googled “top IT certifications”, almost every list mentioned AWS Solutions Architect Associate as one of the exams worth taking. It was only a few weeks ago that I decided to actually go ahead with it. To start preparing, I took the 4-Saturday workshop organized the Computer Science department at The University of Texas at Dallas. At first, the idea was just to add the certification to my Resume in order to make myself more employable. But as the course progressed, I was thoroughly impressed by the wide range of services available to users on the AWS cloud. It looked more and more like an area worth pursuing as a career. The hands-on approach of the workshop conducted by UTD alum Shri Patnaik, also added to my confidence and helped me prepare better. For exam practice, I enrolled in the Udemy practice tests designed by Tutorials Dojo . A few weeks later, I was ready to give the exam.

ALSO SEE Facial Recognition with Python, OpenCV and Raspberry Pi

Amidst the corona virus pandemic, I was fortunate enough to enroll at the Richardson PSI center for a date which was just 2 days before everything started closing down. The test itself was a bit challenging for me as some questions ended up taking more time than I would have expected. However, the practice tests came in handy as I had some experience with the type of questions asked and how to pace myself towards the end. the questions, as expected, covered everything from AWS cloud services to networking concepts to practical considerations and best practices for solution architects. The fact that I had read the AWS whitepapers related to these topics also helped.

When I hit the submit button, my heart was in my mouth (despite numerous exams over the years, I still get very nervous during tests). Everything felt totally worth it when I saw the “Congratulations! You passed..” message on the screen. And that is the gist of how I got my first technical certification 🙂

I am now preparing for a couple of other certification exams. Up next is the AWS Data Analytics certification exam, which I plan to take on April 15. Wish me luck!

CHECK OUT My project portfolio

Facial Recognition with Python, OpenCV and Raspberry Pi

Everybody Loves Recognition! Technically, the definition of recognition is – Identification of someone or something or person from previous encounters or knowledge. But how can it be used to solve real-world problems? This was the premise of a facial recognition project I built using Python and OpenCV on a Raspberry Pi. All the code for this project is available on my github page.

The Problem

Crime tourism, which is very different from ‘crime against tourists’, refers to organized gangs that enter countries on tourist visas with the sole intention to commit crime or make a quick buck. Residing in their destination countries for just a few weeks, they seek to inflict maximum damage on locals before returning to their home countries. It’s something that has been picking up all over the world but especially in Canada, US, Australia.  Here’s an excerpt from a Candian Report:

“Over the weekend, we got a notification that there were at least three people arrested,” he said. “And there were two detained yesterday in a different city. It’s just a growing problem.” When police in Australia broke up a Chilean gang in December, they thanked Canadian police for tipping them off. Three suspects who’d fled Ontario and returned to Chile turned up in Sydney, Australia. The tip from Halton Regional Police led to eight arrests and the recovery of more than $1 million worth of stolen goods.

While the tip came in handy, it would be much more effective to have portable facial-recognition devices at airports and tourist spots to identify criminals and stop them before their crime in a new destination.

The Solution

I used Crime tourism as an example problem to demonstrate the use of facial recognition as a solution. It started with buying a Raspberry Pi v3 ($35) and a 5 MP 1080 p mini Pi camera module ($9) and configuring them.

Then, using Adrian Rosebrock’s brilliant tutorial, I embarked on a 10-hour journey (full of mistakes made on my part) to compile OpenCV on my Raspberry Pi! Here are some important things to remember from this compilation expedition:

•You need to expand your file system to be able to use the entire 32 GB of Pi memory •You need to create a Python 3 virtual environment and always make sure that you’re working inside that environment
•Before you begin the compile process – Increase the SWAP space from 100 MB to 2048 MB to enable you to compile OpenCV with all four cores of the Raspberry Pi (and without the compile hanging due to memory exhausting).
•After installation of NumPy and completion of your OpenCV compilation, re-swap to 100 MB

Python Code for Facial Recognition

I then followed MjRobot’s tutorial to write three simple Python programs for the actual facial-recognition using OpenCV. The object-detection is performed using the Haar feature-based cascade classifiers, which is an effective object detection method proposed by Paul Viola and Michael Jones in their paper, “Rapid Object Detection using a Boosted Cascade of Simple Features” in 2001. It is a machine-learning based-approach where cascade function is trained from a lot of positive and negative images. These images are then used to detect objects in other images. Haar Cascades directory is readily available on the OpenCv github page.

Demonstration

I presented this project on my last day as the President of the UTD club – Travelytics. There, I conducted a live demonstration of the Pi cam capturing my face after I run the first Python program, training the model with the second program, and real-time facial recognition using the third program. Here’s a glimpse:

This project proved to be an excellent route for me to learn the basics of Python, OpenCV, computer vision, Raspberry Pi and how we can implement a low-budget, effective facial recognition solution to complex problems.

Grasping at Straws

Univ

As I am all set to enter the final semester of my Masters degree, I am feeling extremely anxious. While most people are concerned about finding a full-time job in a state or company of their preference, for me that thought is still miles away. My immediate concern is how much I know as a data engineer/analyst. 18 months ago, I made the switch from product manager/actor/writer to Business Analytics student. The goal was to become proficient in the concepts of data mining and analysis, since it was a promising sector and the whole world seemed to be moving in a direction where every industry heavily relies on data science. Now, as I get closer to my graduation date, I keep questioning the extent of my knowledge. And to my disappointment, I keep coming across questions I do not know the answer to.

I need to fix this situation and quickly. I have 117 days to go until my graduation date (May 8, 2020). So, I am taking a start from scratch approach for now. The idea is to revise everything I have learnt at UTD as part of my course, followed by a couple of online courses and certifications. This includes the basics of statistics (p-value, hypothesis testing), database foundations, SQL, NoSQL, mining concepts like principal component analysis, regression techniques, clustering, time series, big data – Hadoop, Spark, Hive, language basics in Python and R, and data visualization techniques.

To devise a plan for this, I am contacting some students I look up to and asking for their advise on the best approach to ensure maximum retention. I am also hoping to audit some classes this final semester. I have just one class left to fulfill my graduation requirements but there is so much more I wish to learn. Natural Language Processing, Applied Machine Learning and Business Data Warehousing are my top picks. I have written to the professors asking for their permission to let me sit in on their lectures.

20191114_191341

Finally, this will also be my last semester as the president of Travelytics – a club I conceived and founded with the help of some of my friends. After one final project presentation (Computer Vision with Python, OpenCV and Raspberry Pi), it will be time to hand over the reins of this organization to the next batch of students.

117 days to go. Time for a final sprint!

Dallas Diaries Video For My Folks

I am studying Information Technology and Management in The University of Texas at Dallas since August 2018. After spending 18 months in Dallas, I returned to Mumbai this December for a short winter break. I wanted to do my best to give my parents and my grandmother a glimpse of my life in at the university. This was difficult as I do not click a lot of pictures. I had, however, captured some videos every now and then. So, I put them together in this video just so that I can give my folks a sneak peek into life in and around Richardson.

Fall Internship, Certifications and The Roadway to Graduation

After 6 months at my first job in the United States, I decided to move on and pursue other avenues. I have several exciting academic projects and certifications lined up over the next few months. My facial recognition robot using Raspberry Pi, Python and OpenCV is almost done. I am preparing to appear for PMP and Cloudera Hadoop certification exams in January 2020, followed by AWS Solutions Architect Associate exam in February 2020. As I get closer to my graduation date (May 2020), I am raring to join the workforce and get my hands dirty solving some real world problems. My iCode internship has given me the push I needed to relaunch my technical career. I have summed up my Fall internship experience at iCode in this LinkedIn post.

The Way She Says Hello

It is probably one of the most commonly-used words of the English language. But when this girl at Starbucks @ Custer&Renner says “Hello“, she instantly stands out! What is it that she does differently that makes you feel welcome, safe, at ease right away? It’s not so much her sweet voice as it is the sincerity behind it.

On one hand, her Hello sounds cute, innocent and charming (almost child-like) and on the other, it’s professional and courteous enough to not make you feel patronized. She makes you feel that no matter how bad your day was or how many challenges lie ahead of you, you can forget about it for now and just enjoy your coffee. Her Hello is the sound of reassurance, of kindness, of earnestness.

Yes, it’s part of her job to say Hello to everyone. But the impact she makes on hundreds of strangers with that one, simple word is testimony to the fact that she is doing something special. For me, this is a great lesson in customer service, in brand management and also in just being a positive energy for people around me. Well done hiring this kid, Starbucks!

UTD Mercury Goes Behind The Scenes of The Rocky Horror Show

For the past two months, I have been part of an incredible experience. I was fortunate enough to get cast in my first musical – The Rocky Horror Show. Everything from the audition process to the rehearsal to the final performances was surreal. For all of us involved, this journey has made its mark as one of the most memorable experiences of our lives. Would you believe if I told you that we had 7 SOLD-OUT SHOWS?! There were long queues every night and many people had to return disappointed (sorry about that!). I wish to write about my whole experience in more detail soon but for now, I’ll leave you with a “Behind the Scenes” video that UTD Mercury created for us. It also features me in a small interview where I express how I am in awe of my fellow Transylvanians!

Travelytics presents BIG DATA IN TRAVEL with Dr. Rick Seaney

When we kicked off our first Travelytics event in 2018, Prof. Kevin Short at UTD was kind enough to grace us with his presence and speak on the use of data in the airline industry. And now, thanks to him, we have a travel domain stalwart visiting UTD and conducting a special lecture for Travelytics. The topic is an exciting one – BIG DATA in the TRAVEL INDUSTRY. We look forward to an exciting session with Dr. Seaney and a bunch of enthusiastic data science students.

Dr. Rick Seaney - Big Data in Travel

UTD Theatre’s Julius Caesar – An Ode to The Cast and Crew

5S3A5301

I can’t express how I feel without sounding like crap..
So I’m going to say it all in the disguise of Rap!

Wears cool t-shirts and also speaks nerd..
When Ally walks in, things start moving forward.

I don’t know how he manages to keep it all in place..
But if it weren’t for Mason, this would be a lost race!

Want to hear Sci-Fi fantasies in a deep, powerful voice?
Ask Hayden what he’d do for his girl, given a choice!

With all her cool ideas and funky attitude,
Lau will lift your spirits up, set the right mood!

If I ever wanted another accent, it would be his..
Coz if I could talk like Benjamin, I’d never hit and miss!

This chess player always makes you feel so special..
With his soothing words and gestures, Zura is just magical

Women are enchanted and go weak in their knees,
When Jake performs his acrobatics with nonchalance and ease!

In a strange and new world, it’s easy to feel at home..
When friendly guys like Kelton explain the history of Rome!

Dresses like a star and always speaks so well..
If I had half of Ricky’s talents, life would be swell!

He often sits by himself, looks very quiet and busy..
But I’ll never forget the moment Dante said, “Fight me, pussy”!

Every evening, without fail, he gets into his zone..
Eric is the rockstar with a very funny bone!

She plays the violin, features in super funny memes..
Michelle is that adorable girl from your dreams!

Teaches me names of food, no knowledge does she lack..
Meghan knows EACH AND EVERY life hack!

She says all the hep words, they all sound legit..
I had never heard of “skedaddle” till Cassie used it!

Her calm voice and pleasant talks make you want to hear more..
Emma is that person, that lovely girl next door!

I just love it when she giggles, I’m glad we got along..
A breath of fresh air, McKinley is a happy song!

Her beautiful eyes light up, showing you her gentle soul..
Alex leaves you in splits, for she is always on a roll!

Sometimes things get boring, and everything seems dead..
And suddenly there is laughter, coz of something Allan said!

With oodles of talent and so much dedication..
O Melinda, you should be called the pride of this nation!
Every time I see you, I see a dear friend..
I’ll cherish your Shakespeare cap till the very end!

The only morning person in the lot I guess..
She is funny, cute and chirpy, when the rest are a mess!
Excellent at yoga but not good at being rude..
Don’t make it bad, just sing “Hey Jude!”

Beautiful and smart and hilarious and lame,
She speaks at a pace that can put a rocket to shame!
She’ll dance into your heart, without making a sound..
You’ll never feel blue as long as Sam is around!

She is a cat person but calls her cat a bitch..
When kitty needs a corner, she can seldom make the switch!
Her laughter makes you feel the world’s awesome after all..
Raquel is like the heartwarming colors of Fall!

All the fun warm-ups and every catchy song..
And every social outing, without her would just go wrong!
Watching her play Caesar has been such a treat..
And Osi as a person is so cute and sweet!

You can’t die of hunger if you have a snack..
You don’t take a train that’s not on track..
You won’t place a hat on a damn shoe rack..
And you aren’t born cool, unless you are Zach!

Her warmth is what good things in the world are all about..
Her charm can make even the grumpiest people pout!
When days seem dark and every moment dull,
All you really need is a dose of Ravishing Rachel!

Last, though not last in love, is the boss I can’t thank enough..
She seems to me as sweet, as she seems to be tough!
I adore her smile, and her stare gives me fever..
But please know, Shelby, I am grateful forever!