A machine-learning photo-sharing app collaborating with the startup, Cortica.
ROLE
Design Lead
Creative Director
Visual Designer
Studio
Fantasy Interactive
WITH is an artificial-intelligence (AI) based app startup founded by Cortica.
This was a collaborative project with a virtual group of over 100 talented software and AI developers abroad and within a NYC startup space. The project was truly agile and was put out to test in market in under a month. The app aggregates your imagery and can pinpoint exactly what is contained in that image as well as presenting a full-story of an event which you can easily share.
Challenge
WITH Photo Sharing App
The goal of the project was to create a beautiful, simple, and intelligent photo sharing app.
In the world, where users are drowning in the photos that they take with their phones, the percentage of shared photos remains very small.
We've addressed that with AI analysis of user's gallery. WITH scanned user's photos and automagically suggested the best photos to share, and the groups of people to share them with.
Behind this simple and elegant UI ran the state-of-art image classifiers, face detection and recognition.
Process
Weekly sprints
3x/week white-boarding sessions
Agile process + immediate prototyping
Directly working with UX lead
User tested and live within 1 month
Second beta launched within 2nd month
Competitive Analysis
Key Findings
data
It seems there’s a lot of photo sharing apps out on the market, but not a lot that actually analyze data.
Sharing
Though the market was saturated, there was a gap in that few formed groups for a social sharing aspect.
Tagging
Several apps had data tagging was incorrect. This is where Cortica stood out, as it was highly accurate.
Personas
The Technophobe
Elizabeth
Woman age 25-45
Tech friendly
Shares content with family and friends regularly
The Privacy Minded
Richard
Man age 25-45
Prefers private groups
Prefers simple technology
The Family Tied
Anne
Woman 45+
Mother of daughter who shared WITH
Has a very tight-knit family
Enjoys seeing pictures of family
Design Principles
✍️ Automatic storytelling
Automatically generate stories from users photos. Cortica can automatically understand and extract different audiences (groups of people) by their appearances in visual stories. Eg, identify family members, friends I'm going to drink a beer, friends I'm hiking, all my colleagues, etc. We can Auto-suggest stories for sharing and Auto-suggest audiences (groups of people)
🙂 Face detection
Very high accuracy face recognition and clustering. We will have best in class face detection and the capability to automatically identify the user’s friends through Facebook integration. We will also be able to make use the social graph as well to know relationships between people.
🔍 Photo Aggregation + Search
Currently we can process photos on device and Facebook. In future we will synch Instagram, Dropbox etc as well to provide a complete view of the users photos. Users will be able to search for photos using quite complex and precise terms and strings.
👋 Human Organization
Build very precise profiles of people based on the photos that they take. This can serve to cluster the important things in their lives at that moment and display the photos with meaningful and highly granular labels. i.e. rather than dog it can identify what breed of dog you own. It can tell the difference between kick-boxing and jiu-jitsu. Surfaces memories in a delightful and human way.
👪 Connections + Building Relationships
Phone photography
Honest + real
Family moments
Emotional
Intimate
Bonding
🔒 Privacy
Security
Privacy
Closed groups
Not mass sharing
Human-to-human
No advertising
Sketches
Fuses smart technology with your imagery | WITH is an all-in-one tool | Square icon and squared UI implies framing
AI-Driven Photography
Cortica is developing autonomous artificial intelligence (AI) technology designed to enable machines to think. By leveraging proprietary brain research to create unsupervised AI, Cortica has developed an effective computer-vision system.
The company uses an innovative self-learning technology backed by more than 200 patents to develop multiple products that can understand images on a human level, significantly exceeding the current capabilities of the industry.
Cortica’s goal is to embed its technology in all next-generation platforms for which understanding images is a critical task, including autonomous vehicles, smart city applications, drones, media, robotics, and image-screening analysis.
Visual Execution
Bringing wireframes to life
Brand Explorations
Outcomes
At the time of the release of the 2nd beta, Cortica ranks one of top 3 coolest tech companies in Israel
Cortica ranks as number 1 patent holder amongst AI companies
The technology begins applying software and chips from the lab into the automotive industry for self-driving cars