Best unofficial Apache Server developers community
Username
Forgot password?
Sign in with Twitter account
Sign in with Facebook account

SQL access to CouchDB views : Easy Reporting

Following up on my previous blog about enabling SQL Access to CouchDB Views I thought I'd share what I think the single, biggest advantage is: The ability to connect, run of the mill, commodity BI tools to your big data system.

While the video below doesn't show a PRPT it does show Pentaho doing Ad Hoc, drag and drop reporting on top of CouchDB with LucidDB in the middle, providing the connectivity and FULL SQL access to CouchDB. Once again, the overview:

HotorCold.png

BI Tools are commoditized; consider all the great alternatives available inexpensively (either in Open Source for free, Open Core, or even simply proprietary). Regardless of what solution you choose, these tools have fantastic, easy to use capabilities that are very easy for business users to build their own reports. After all, shouldn't your developers be extending/creating new applications instead of fiddling with what filters your analysts/executives want to see on their dashboard?

Driving the developer out (as much as possible) is one of the best reasons to try and enable your cool, CouchDB views via SQL.

Here I'll demonstrate, once we've connected LucidDB to our CouchDB view, how a BI Tool can:

  • Easily see the data, and understand it's datatypes. Metadata is well understood between SQL databases and BI tools.
  • We can easily use a familiar query language, SQL, that allows for aggregation, filtering, and limiting. This gives a huge swath of BI tools the ability to talk to CouchDB.
  • We translate the SQL we receive into optimized* RESTful HTTP view requests.

Per a reader suggestion here's a video showing the solution, as opposed to the screenshots (PS - Let us know what you think about the CouchDB SQL access, or also the Video vs Screenshot approach).

It picks up right after the previous section. Once we have that CouchDB view in LucidDB then Pentaho (or other BI tools) can connect and access, do ad hod reporting like they always have). As a certified database for Pentaho, you can be quite comfortable that Pentaho will work very very well with LucidDB.

PENTAHO does not even KNOW it's talking to CouchDB -> It has NO idea; Pentaho thinks it's a database just like any other

Without further delay:


*optimized = we have a few optimizations available to us, that we've not yet put into the connector. For instance, the ability to filter to a particular key (where key = XYZ) pushed down, or group_level=*. This will come over time as we enhance the connector. For now, we're doing very little in terms of pushing down SQL filters/aggregations into the HTTP view. However, your view itself is almost CERTAINLY aggregated and doing this anyhow.


PlanetMySQL Voting: Vote UP / Vote DOWN
Source Article
Comments
0
Be the first to comment

Join with account you already have


Sign in with Twitter account
Sign in with Facebook account
Sign in with Google Friend Connect
avatar
Tags: query language sql, open core, sql databases, datatypes, business users, swath, drag and drop, aggregation, dashboard, metadata, commodity, pentaho, open source, c
Reporting in CouchDB
Jul 27, 2010
I need to write some reports on top of the data in my couch db application. My use case is a central database monitoring the data coming in from a bunch of satellite sites, and they want to generate aggregate reports on the data by site and by…

Views in Couchdb 1.0.1 on Ubuntu 9.10
Oct 28, 2010
Howdy, I'm trying to install couchdb 1.0.1 on an ubuntu 9.10, and I'm running into a lot of troubles with creating views for a large dataset. (250,000 documents). It works fine for small datasets. I copied all of the documents to my mac laptop…

indexing of couchdb views?
Jan 27, 2011
Imagine that I have a database of recipes where a database of recipes where users can post comments, images and perhaps even comments on the images. I would like ES to be able to search on comments, but also to return the parent object (the…

Would CouchDB and Views suitable for Raw sensor data?
Jul 13, 2010
Hi, Recently I saw Aaron Miller has an Alpha of CouchDB running on Android, which has me very excited about the convergence of these two technologies. One project where CouchDB on Android could help us would be for the logging of Bluetooth sensor…

CouchDB becoming unusable as Database/Views increase in size.
Dec 21, 2010
Hi all, I've been using CouchDB to track the results of testing Firefox and have found that as the database and view sizes have increased CouchDB is becoming less and less viable as a solution going forward. I don't wish to switch to a…

high IO wait and unresponsible views after couchdb restart
Apr 27, 2011
Hi folks. I'm experiencing strange problem with CouchDB. I have some large databases (about ~30-40 GB with ~2.5M documents in it). There also (sure) indexes. Index files are 300-700 MB after compaction. Sometimes (it's inreproducible), after…

question on CouchDB views: how to use a query sting (formula) in the view
Jul 26, 2010
Hi there, I am using CouchDB for some time now and now I am stuck with the following question. Lets say I store some values from some Physics experiments in couchdb: ID x1 x2 1 1 1.1 2 2 1.2 3 3 1.3 4 4 1.4…

CouchDB Web Server access on a LAN.
Nov 17, 2010
I'm trying to access CouchDB on a PC on my LAN using its IP address ie. 192.168.1.2:5984 and failing. I can access it on the other PC using localhost but using the PC's IP address on the same PC also fails. I can ping the other PC ok. I also tried…

ANN: CouchDB access via AMQP
Aug 30, 2010
I've been working on a plugin for the RabbitMQ AMQP broker that relays messages from the broker to HTTP REST APIs. I call it the "webhooks" plugin. I've been testing against CouchDB 1.0.1 and I'm able to bulk load/update/delete documents as fast…

Reopened: (HIVE-621) Inconsistent reporting of "null" and delimiter across access types
Mar 7, 2011
[ https://issues.apache.org/jira/browse/HIVE-621?page=com.atlassian.jira .plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach reopened HIVE-621: