Search by Sketch








Channel: Tech
Uploaded: February 19, 2008 at 5:55 am
Author: chrisharrisoncmu

Length: 00:02:32
Rating: 5.00
Views: 1185



Embed Code:

Webmaster Video Comments: After several months of intense development alongside Stacey Kuznetsov, the Rapid Content-Based Image Search (RCBIS) engine was ready for use in user oriented programs. The most obvious and appealing project was to develop an image search engine which took not text, but a sketch as input. Search by Sketch was born - developed by Stacey Kuznetsov, Teobaldo Fernandez and myself.Mirroring the RCBIS color model, a limited array of colors is available to users. A usability study found that users wanted to draw unnecessary detail, which wasted time and actually hurt search accuracy. Only one, large brush size is provided to preclude this behavior. The red 'X' icon clears the sketch.Users can draw into two different sketch panels. The upper panel is used to search for image content. Images that closely matched this sketchy are ranked highly in the search results. However, images that have commonalities with the sketch drawn in the lower panel are negatively weighted in the search results. These two sketch panels provide a mechanism that acts like a boolean search.Search results are presented in order of relevance, with the closest matches at the top. To provide additional detail for probable matches and include as many results on screen as possible, thumbnail size is varied. Since our image search algorithm is supposed to be fast (as per the 'Rapid' in 'RCBIS'), we can hit the DB many times a second. This allows us to present live search results as users are sketching their input.
nperriault (May 22, 2008 at 11:31 am)
How my god, this is fucking genius!!! Can we get a working demo of the software somewhere?
lmjabreu (March 6, 2008 at 2:03 pm)
jesus 0 commentsamazing work, congrats.

1