ArangoDB Logstash Output: Efficient Data Integration
Inspired by a question on StackOverflow, I did some investigation about how to make Logstash send log events to ArangoDB.
There is no dedicated Logstash output plugin for ArangoDB on the Logstash plugins page, so I had already accepted to write one on my own.
Browsing the plugins page for inspiration, I found an HTTP output plugin for Logstash. It seems to be general enough that it can send the log event in JSON format to any HTTP-speaking backend.
ArangoDB’s API is JSON over HTTP, so it sounded like a perfect match. I briefly tried it out and it seemed to work fine.
Elasticsearch Plugin: ArangoDB Integration | ArangoDB ’13
ArangoDB River Plugin for ElasticSearch
ArangoDB offers now a plugin for automated data transfer from ArangoDB into ElasticSearch.
If you want to benefit from ElasticSearch’s full text search capabilities for your ArangoDB document data, the easiest way to do so is to use this new plugin.
Implementing the push approach, otherwise, would make it necessary to write your own indexer, using your favorite programming language.
The ArangoDB river plugin software is an initial alpha version and licensed under the Apache 2 license.
(more…)
Get the latest tutorials,
blog posts and news: