Jump to: navigation, search

Searchlight

Revision as of 22:10, 24 March 2016 by Travis Tripp (talk | contribs) (Screencasts)

Mission Statement

To provide advanced and scalable indexing and search across multi-tenant cloud resources.

Project Links

Developer Documentation http://docs.openstack.org/developer/searchlight/
Source code https://github.com/openstack/searchlight
Gerrit Reviews https://review.openstack.org/#/q/status:open+project:openstack/searchlight,n,z
Bug tracker https://bugs.launchpad.net/searchlight
Feature tracker (see Glance for historical tracking) https://blueprints.launchpad.net/searchlight
IRC #openstack-searchlight
Meeting Times http://eavesdrop.openstack.org/#Searchlight_Team_Meeting
Meeting Agenda https://etherpad.openstack.org/p/search-team-meeting-agenda
Meeting Logs http://eavesdrop.openstack.org/meetings/openstack_search/

Overview

Searchlight was originally developed and released in the Kilo release of Glance as the Catalog Index Service [1]. At the Liberty Summit we decided to broaden the scope to provide advanced and scalable search across multi-tenant cloud resources.

[1] http://specs.openstack.org/openstack/glance-specs/specs/kilo/catalog-index-service.html

This is intended to dramatically improving the search capabilities and performance of various OpenStack cloud services.

It accomplishes this by offloading user search queries from existing API servers by indexing their data into ElasticSearch. ElasticSearch is a search server based on Lucene. It provides a distributed, scalable, near real-time, faceted, multitenant-capable full-text search engine with a RESTful web interface and schema-free JSON documents. ElasticSearch is developed and released as open source under the terms of the Apache License. Notable users of ElasticSearch include Wikimedia, StumbleUpon, Mozilla, Quora, Foursquare, Etsy, SoundCloud, GitHub, FDA, CERN, and Stack Exchange. (Source: http://en.wikipedia.org/wiki/Elasticsearch). The elastic-recheck project also uses Elasticsearch (and kibana) to classify and track OpenStack gate failures. (Source: http://status.openstack.org/elastic-recheck)

Screencasts

Design

The design is based off the Catalog Index Service in Glance. It will be refined moving forward as cross project needs are discovered and defined.

Concept Overview

Searchlight-Concept-1.png

Concept Internals Overview

Get Involved

Please join with us to help move forward together as a community! We are sure that the ideas and concepts can use refinement and we'd like to identify where we can best fit in to the ecosystem.