PAWS
The Package Alert from Wolfie Service
By Aidan Brooks, Matthew Ma
Current Issues
● Students do not know when their packages arrived at Rectory and when they should pick up the packages
● Many students go to check their packages every day in the package room
● Students are hard to find their packages because of the package room are messy and filled with packages
What does PAWS do?
camera > picture > text > name > email > sending
Camera
● The camera is made for the raspberry pi
● We can use those images to have a low frame rate live video in the application to preview for the user
● We need a high resolution camera (1080p) in order to properly do the next step, text extraction
Text Extraction
● Code analyzes the shape of the letters and stores the extracted text into a string variable
● What does the extracted text look like?
Fuzzy Matching
● Fuzzy Matching compares pieces of text and gives them a “similarity score”
- It is best used for text that is not perfectly alike as a substitution for standard matching
- Out of 100; it is a percentage
● There are a few types
Madeline Karp
Different Types of Fuzzy Matching
Simple Ratio
Similarity Score(%)
Names
Token sort Ratio
Score(%)
Similarity
Names
Partial Ratio
Score(%)
Similarity
Names
Token set Ratio
Similarity Score(%)
Names
Matching to Email Database
● We have a spreadsheet of all students and faculty names and email addresses ○ We use fuzzy matching to match the extracted text through this database to the most likely recipient
Sending the Email
What does that email look like?
● We use HTML code to format the email and have variables like “your name”, “number of packages”, and the “4th grade image,” which change depending on the settings.
How do we send it?
● Once the program selects the right name, simply click the “send email” button, and our code does the rest!
4th Grade Presentation
● We presented our product to the 4th grade students.
● They kindly drew logos for us, 18 total.
● We included them in every email PAWS sent and we give credit for which fourth grader drew it.
Example Email
This is what the email will look like!
GUI
● Graphics User Interface
● The GUI is how the user interacts with our code
● Instead of seeing the code itself, they see an app with all the buttons and functions they need
○ Just like on your phone or tablet!
● We write it in the code so that when the code is run, it appears and is ready to use.
User Testing Trial 1:
Times and how many packages
● Trial 1: 6 packages in 3 minutes
● Trial 2: 5 packages in 4 minutes
● Trial 3: 5 packages in 2 minutes
● Totals: 16 packages in 9 minutes
● Per package: 34s
Improvements:
Reduce mis-matches: Use token set ratio and remove “Pomfret, ct, 06258”, etc. because they appear on every package and only confuse the fuzzy matching system.
Camera upgrade: Used an autofocusing camera.
Email appearance: added 4th grade drawings to emails.
Improvements: Laser Cutting with Ms. Dubinsky
User testing 2:
Times and how many packages
● 5 packages in 1 minute 30 seconds
● 7 packages in 1 minute 35 seconds
● 7 packages in 2 minutes 36 seconds
● Total: 19 packages in 5 minutes 41 seconds
● Time per package: 18s
Improvements:
UX improvements: If a person receives multiple packages at one time, add an input for the number of packages and add to the email service that number as well.
Autofocus problems: 80% of the time it would focus, but 20% not. How to fix? User instructions.
Camera usability: Add handles and longer cable to camera, so you don’t have to pick up the whole computer at once.
Final User Testing with non-expert users:
Times and how many packages
● 5 packages in 2 minutes 56 seconds
● 7 packages in 1 minute 47 seconds
● Total: 12 packages in 4 minutes 43 seconds
● Time per package: 24s
Thank you Sam, Jack, and Jerry
Post-Testing Survey
● Do you think the software is easy to use? What are some improvements we could make?
○ Yes
○ Add labels to the text boxes so people know what it does
○ Refresh the output box every time a new picture gets taken
● Would you feel comfortable using this on your own without us supervising?
○ Yes
Improvements
● User Interface: Added labels to the text boxes in the GUI and refreshed output every time a new picture gets taken
Instructables and Github
Instructables:
Instructable is a website that we use to create instructions for our user
It contains link to different downloading sites
Tells you how to setup Raspberry Pi
Github: Tells you how to use the code and install it
Demonstration time!