Jump to: navigation, search

Searchlight

Revision as of 15:10, 16 June 2015 by Travis Tripp (talk | contribs) (Concept Internals Overview)

Mission Statement

To provide advanced and scalable indexing and search across multi-tenant cloud resources.

Project Links

Source code (current - forked from Glance) https://github.com/lakshmisampath/searchlight/
Source code (proposed) https://github.com/openstack/searchlight
Bug tracker https://bugs.launchpad.net/searchlight
Feature tracker (see Glance for historical tracking) https://blueprints.launchpad.net/searchlight
IRC #openstack-searchlight
Meeting Times http://eavesdrop.openstack.org/#Search_Team_Meeting
Meeting Agenda https://etherpad.openstack.org/p/search-team-meeting-agenda
Meeting Logs http://eavesdrop.openstack.org/meetings/openstack_search/

Overview

Searchlight was originally developed and released in the Kilo release of Glance as the Catalog Index Service [1]. At the Liberty Summit we decided to broaden the scope to provide advanced and scalable search across multi-tenant cloud resources.

[1] http://specs.openstack.org/openstack/glance-specs/specs/kilo/catalog-index-service.html

This is intended to dramatically improving the search capabilities and performance of various OpenStack cloud services.

It accomplishes this by offloading user search queries from existing API servers by indexing their data into ElasticSearch. ElasticSearch is a search server based on Lucene. It provides a distributed, scalable, near real-time, faceted, multitenant-capable full-text search engine with a RESTful web interface and schema-free JSON documents. ElasticSearch is developed and released as open source under the terms of the Apache License. Notable users of ElasticSearch include Wikimedia, StumbleUpon, Mozilla, Quora, Foursquare, Etsy, SoundCloud, GitHub, FDA, CERN, and Stack Exchange. (Source: http://en.wikipedia.org/wiki/Elasticsearch). The elastic-recheck project also uses Elasticsearch (and kibana) to classify and track OpenStack gate failures. (Source: http://status.openstack.org/elastic-recheck)

Screencasts

To help explain the ideas of the project, we have a quick screencast demonstrating the concepts. This was done by taking the Glance Catalog Index Service and adding in a plugin for Nova and then modifying horizon to use it. This is what was demonstrated at the Liberty Design Summit in both a Glance fishbowl session and a Horizon fishbowl session.

Design

The design is based off the Catalog Index Service in Glance. It will be refined moving forward as cross project needs are discovered and defined.

Concept Overview

Searchlight-Concept-1.png

Concept Internals Overview

Get Involved

Please join with us to help move forward together as a community! We are sure that the ideas and concepts can use refinement and we'd like to identify where we can best fit in to the ecosystem.