To provide advanced and scalable indexing and search across multi-tenant cloud resources.
|Feature tracker (see Glance for historical tracking)||https://blueprints.launchpad.net/searchlight|
Searchlight was originally developed and released in the Kilo release of Glance as the Catalog Index Service . At the Liberty Summit we decided to broaden the scope to provide advanced and scalable search across multi-tenant cloud resources.
This is intended to dramatically improving the search capabilities and performance of various OpenStack cloud services.
It accomplishes this by offloading user search queries from existing API servers by indexing their data into ElasticSearch. ElasticSearch is a search server based on Lucene. It provides a distributed, scalable, near real-time, faceted, multitenant-capable full-text search engine with a RESTful web interface and schema-free JSON documents. ElasticSearch is developed and released as open source under the terms of the Apache License. Notable users of ElasticSearch include Wikimedia, StumbleUpon, Mozilla, Quora, Foursquare, Etsy, SoundCloud, GitHub, FDA, CERN, and Stack Exchange. (Source: http://en.wikipedia.org/wiki/Elasticsearch). The elastic-recheck project also uses Elasticsearch (and kibana) to classify and track OpenStack gate failures. (Source: http://status.openstack.org/elastic-recheck)
To help explain the ideas of the project, we have a quick screencast demonstrating the concepts. This was done by taking the Glance Catalog Index Service and adding in a plugin for Nova and then modifying horizon to use it. This is what was demonstrated at the Liberty Design Summit in both a Glance fishbowl session and a Horizon fishbowl session.
- Concept Demoː https://youtu.be/eGnGr48E5_4
- Liberty PTL Overviewː https://www.youtube.com/watch?v=yU5CrAOAlkA
The design is based off the Catalog Index Service in Glance. It will be refined moving forward as cross project needs are discovered and defined.
- Glance Specificationː http://specs.openstack.org/openstack/glance-specs/specs/kilo/catalog-index-service.html
Concept Internals Overview
Please join with us to help move forward together as a community! We are sure that the ideas and concepts can use refinement and we'd like to identify where we can best fit in to the ecosystem.