AI-powered image search tool for clutter-free libraries

Need a custom AI solution for your business? Look no further than Gradient Insight. Our team has the expertise to create a tailored solution that meets your unique needs and helps drive growth and success. Contact us today to learn more.


We were approached by a startup based in the US with a problem: as smartphone usage increases, so does the number of pictures families accumulate, making it difficult to locate specific images. The startup wanted to create an app that would allow users to search for images using natural language, like “pictures of me and my wife on the beach eating ice cream.” However, they didn’t know how to extract this information from the images. That’s where we came in.


We analyzed the latest artificial intelligence models and determined not only was image search possible, but also a range of additional features the startup hadn’t considered. Our goal was to develop a system that could:

  • Detect all elements in an image, including people, locations, colors, and activities (using object detection and image captioning)
  • Match the user’s query with the elements detected in the image using natural language processing (NLP)
  • Return the most relevant images with minimal latency (using clustering)
Owl Flying Towards


We took a pragmatic approach, focused on delivering a successful outcome for the client. Our solution was developed iteratively, with each version bringing the client closer to their desired result. We implemented state-of-the-art object detection and image captioning, which allowed us to group individual image elements into descriptive sentences. Then, using contrastive learning, we were able to match these captions with user queries, yielding the desired results.

The Solution

Finding the perfect solution for this project was an iterative process, with each version the client was getting closer to its desired outcome!


Object Detection

Using the state-of-the-art models for OD wasn't enough, since our client wanted a general description of the image

Learn More

Image Captioning

Adding IC grouped the individual detections into a descriptive sentence, which matched the client's requirement

Learn More

Natural Language Processing

Use Contrastive Learning to match user queries with image captions yielded the results that the client was looking for!

Learn More

The Results

95% Image Extraction

The system is able to extract the desired images using only natural language queries

96% Image Captioning

The captions generated successfully described all the traits required by the customer

100% Flexible System

The system has been designed in such a way that new features can be easily integrated

Download in PDF format

Iu Ayala | CEO & Founder

Iu Ayala | CEO & Founder

I am a data scientist and robotics engineer with over 8 years of experience in delivering successful and impactful solutions using supervised and unsupervised learning, algorithm design, and programming. As the CEO of Gradient Insight, a consulting firm that helps clients make data-driven decisions through the use of AI, I have a track record of delivering customized solutions across a range of industries. I am passionate about using data and technology to solve complex problems and am always open to discussing potential collaboration opportunities. If you have a project that could benefit from my expertise, please feel free to reach out and connect on LinkedIn.

Ready to harness the power of Data Science for your business?

Contact us today to learn more about how our team can help you achieve your data-driven goals!

Other Case Studies