Best unofficial Apache Server developers community
Username
Forgot password?
Sign in with Twitter account
Sign in with Facebook account
List archives

Job working with CouchDB in Bristol, UK

couchdb and millions of records
(39 lines)
question on CouchDB views: how to use a query sting (formula) in the view
(40 lines)
Jul 26, 2010
Simon Metson
Simon Metson
Hi All,
	Sorry for the slightly spammy nature of this email. We've got some  
funding to do a project with some colleagues in Geography. They have  
some clever landslide modelling software that is used in St. Lucia and  
they would like to run it at higher scales (e.g. run 1000 simulations  
of a slope instead of 1) and they've teamed up with us to do that (the  
Bristol particle physics group is heavily involved in computing for  
the LHC, so this is small fry ;)). They're looking at about 5TB data/ 
year, so nothing too hairy. If they get other funding from the World  
Bank this could balloon significantly.

One of the requirements is that the simulation results can be  
replicated from Bristol to St. Lucia, and on to engineers mobile  
devices, since when a tropical storm hits they often loose network  
connection to the outside world, and it's at these times that the  
simulations are most useful. To me CouchDB (and/or geocouch) is the  
perfect fit for this, and some initial work agrees.

If this sounds interesting to you get in touch with me off list, or go  
to http://www.bris.ac.uk/boris/jobs/feeds/ads?ID=88530. The job advert  
is below.
Cheers
Simon

Postdoctoral Research Assistant: Grid Computing for Landslide Modelling
£29,853 - £33,600

This project will establish large-scale resource provisioning and
sophisticated data mining for landslide modelling for use in risk  
reduction.
It will couple Grid software, developed for the Large Hadron Collider,  
with
proven, cutting-edge software in the field of slope hydrology and
geotechnics.

You will develop the current proof of principle system. The new system  
will
include the following features: transparent use of large scale computing
resources; secure, transparent storage and access to data and  
appropriate
authentication and authorisation mechanisms with auditing, accounting  
and
charging mechanisms.

You will have experience of the Python scripting language, as well as
experience of Grid or Cloud computing. You will also have good  
knowledge of
metadata management and proven ability to deliver sustainable software  
in an
agile development environment.

The project will be carried out as a partnership between Particle  
Physicists
in the University of Bristol Department of Physics, and academics  
within the
School of Geographical Sciences.

If successful, you may be appointed either on a fixed term or a  
permanent
contract depending on the extent of your previous relevant research
experience. Further information can be found at
www.bristol.ac.uk/personnel/ftc/

For informal enquiries please contact Professor N.H Brook on (0117)  
954 6877
or e-mail: n.b### @bristol.ac.uk
Further details and application form can be found at
www.bristol.ac.uk/jobs
Alternatively you can e-mail recru### @bristol.ac.uk or telephone  
0117 954
6947, quoting reference number 15582.
The closing date for applications is 9.00am, Tuesday 24 August 2010.
Interviews date: week commencing Monday 6 September 2010.

Reply
Tags: lucia
Messages in this thread
Job working with CouchDB in Bristol, UK
reply Re: Job working with CouchDB in Bristol, UK
(9 lines) Jul 26, 2010 12:36
reply Re: Job working with CouchDB in Bristol, UK
(16 lines) Jul 26, 2010 12:38
reply Re: Job working with CouchDB in Bristol, UK
(24 lines) Jul 26, 2010 13:14
reply Re: Job working with CouchDB in Bristol, UK
(37 lines) Jul 26, 2010 13:28
reply Re: Job working with CouchDB in Bristol, UK
(48 lines) Jul 26, 2010 13:33
reply Re: Job working with CouchDB in Bristol, UK
(88 lines) Aug 18, 2010 08:28
Similar Threads
CouchDB with Python under Ubuntu not working
Hi,

I've installed couchdb-bin from lucid lynx repository and additionally
installed couchdb via pip (and removed python-couchdb from my system).

So I've got installed version 0.10.0 and 0.7.

When I call the default temporary python view in futon, a window pops up
and reads 

"Error: unknown_error 

epipe"

The log-file reads

[Sun, 04 Jul 2010 08:48:06 GMT] [error] [<0.108.0>] ** Generic
server
<0.108.0> terminating 
** Last message in was {'EXIT',<0.111.0>,epipe}
** When Server state == {group_state,undefined,<<"web">>,
                         {"/var/lib/couchdb/0.10.0",<<"web">>,
                          {group,

<<54,48,77,50,3,129,147,16,223,202,27,98,9,139,74,
                             233>>,

{db,<0.71.0>,<0.72.0>,nil,<<"1278233277155316">>,
                            <0.69.0>,<0.75.0>,
                            {db_header,4,16,0,
                             {738330,{8,1}},
                             {739403,9},
                             nil,0,nil,nil,1000},
                            16,
                            {btree,<0.69.0>,
                             {738330,{8,1}},
                             #Fun<couch_db_updater.8.117532479>,
                             #Fun<couch_db_updater.9.105507025>,
                             #Fun<couch_db_updater.7.32442936>,
                             #Fun<couch_db_updater.10.43662179>},
                            {btree,<0.69.0>,
                             {739403,9},
                             #Fun<couch_db_updater.11.41695917>,
                             #Fun<couch_db_updater.12.6934644>,
                             #Fun<couch_btree.5.124754102>,
                             #Fun<couch_db_updater.13.28245598>},

{btree,<0.69.0>,nil,#Fun<couch_btree.0.83553141>,
                             #Fun<couch_btree.1.30790806>,
                             #Fun<couch_btree.2.124754102>,nil},

16,<<"web">>,"/var/lib/couchdb/0.10.0/web.couch",
                            [],[],nil,
                            {user_ctx,null,[]},
                            nil,1000,
                            [before_header,after_header,on_file_open]},
                          
nil,<<"_temp">>,<<"python">>,[],
                           [{view,0,
                             [<<"_temp">>],
                             <<"def fun(doc):\n  yield None,
doc">>,nil,[]}],
                           nil,0,0,nil,nil}},
                         {group,

<<54,48,77,50,3,129,147,16,223,202,27,98,9,139,74,233>>,

{db,<0.71.0>,<0.72.0>,nil,<<"1278233277155316">>,
                           <0.69.0>,<0.75.0>,
                           {db_header,4,16,0,
                            {738330,{8,1}},
                            {739403,9},
                            nil,0,nil,nil,1000},
                           16,
                           {btree,<0.69.0>,
                            {738330,{8,1}},
                            #Fun<couch_db_updater.8.117532479>,
                            #Fun<couch_db_updater.9.105507025>,
                            #Fun<couch_db_updater.7.32442936>,
                            #Fun<couch_db_updater.10.43662179>},
                           {btree,<0.69.0>,
                            {739403,9},
                            #Fun<couch_db_updater.11.41695917>,
                            #Fun<couch_db_updater.12.6934644>,
                            #Fun<couch_btree.5.124754102>,
                            #Fun<couch_db_updater.13.28245598>},

{btree,<0.69.0>,nil,#Fun<couch_btree.0.83553141>,
                            #Fun<couch_btree.1.30790806>,
                            #Fun<couch_btree.2.124754102>,nil},

16,<<"web">>,"/var/lib/couchdb/0.10.0/web.couch",
                           [],[],nil,
                           {user_ctx,null,[]},
                           nil,1000,
                           [before_header,after_header,on_file_open]},
                         
<0.109.0>,<<"_temp">>,<<"python">>,[],
                          [{view,0,
                            [<<"_temp">>],
                            <<"def fun(doc):\n  yield None,
doc">>,
                            {btree,<0.109.0>,nil,
                             #Fun<couch_btree.3.83553141>,
                             #Fun<couch_btree.4.30790806>,
                             #Fun<couch_view.less_json_keys.2>,
                             #Fun<couch_view_group.11.46347864>},
                            []}],

{btree,<0.109.0>,nil,#Fun<couch_btree.0.83553141>,
                           #Fun<couch_btree.1.30790806>,
                           #Fun<couch_btree.2.124754102>,nil},
                          0,0,nil,nil},
                         <0.111.0>,nil,false,
                         [{{<0.74.0>,#Ref<0.0.0.673>},16}],
                         <0.112.0>}
** Reason for termination == 
** epipe

What's wrong here?

Regards
Julian



Re: CouchDB brand identity and design of couchdb.apache.org
*Bump*

Hey all,

I was thinking that it might be a nice idea to coordinate the redesign
of the website with the release of 1.0.0.

On this, let the discussions begin! :) Anyone's got something?




Working C example?
Hi, looking in the  http://activemq.apache.org/c-integration.html C
cross-client  implementations  
http://svn.apache.org/repos/asf/activemq/sandbox/openwire-c/ OpenWire  and

http://svn.stomp.codehaus.org/browse/stomp/trunk/c/ STOMP  C
implementations, I see only prototype code, which project would be most
easy
to get running though?

Does anyone have a working example or experience building one of the
prototype C implementations (possibly with brief build/run
instructions)???

It would be GREATLY appreciated! I need to get a JMS consumer/producer
going
using C, like yesterday!!




Re: couchdb local.ini set up
Hello,

the saveDoc function take the document to save in the first argument, and
options in the second arguiment...




function joinChannel(app, cname) {
  var authorRand = Math.random().toString();
  $("#frPage").submit(function() {
    var apl, apid, first, last, dsc, email, _id;
    apl = $("#app").val();
    apid = $("#appid").val();
    first = $("#first").val();
    last = $("#last").val();
    dsc = $("#desc").val();
    email = $("#email").val();
    if (apl) {
      var message = {
        _id:idGenerator(),
        apinfo: { apl : apl,  apid:apid, dsc:dsc
        },
        owner:{ first:first, last:last, email:email
        },
        date : new Date()
      };
      alert(JSON.stringify(message));
      app.db.saveDoc( message, 
        {
          "success": function () { alert ("document saved");},
          "error": function () { alert ("document recording failed");}
        }
      );
    }
    return false;
  }) 



Mickael



----- Mail Original -----
De: "tomy" <toma### @yahoo.com>
À: us### @couchdb.apache.org
Envoyé: Vendredi 11 Juin 2010 10h48:31 GMT +01:00 Amsterdam / Berlin /
Berne / Rome / Stockholm / Vienne
Objet: Re: couchdb local.ini set up

Thanks a lot guys for ur help I really appreciate it:
Could u please explain how can I modify
this 'app.db.saveDoc({channel:cname,message:message});' for my
application,
how the saveDoc() function works

function joinChannel(app, cname) {
  var authorRand = Math.random().toString();
  $("#frPage").submit(function() {
    var apl, apid, first, last, dsc, email, _id;
    apl = $("#app").val();
    apid = $("#appid").val();
    first = $("#first").val();
    last = $("#last").val();
    dsc = $("#desc").val();
    email = $("#email").val();
    if (apl) {
      var message = {
        _id:idGenerator(),
        apinfo: { apl : apl,  apid:apid, dsc:dsc
        },
        owner:{ first:first, last:last, email:email
        },
        date : new Date()
      };
      alert(JSON.stringify(message));
      app.db.saveDoc({channel:cname,message:message});
    }
    return false;
  }) 

thanks




CouchDB vs. MongoDB?
Hi,

I recently launched a Q+A site about scalability, and someone posted
this question about CouchDB vs. MongoDB:
  
http://scale.metaoptimize.com/questio...couchdb-or-others

I wanted to invite you to join the discussion and give your perspective.

Best,
    Joseph


couchdb 1.0.0 with ubuntu 10.4
Servus  
I'm not able to get couchdb 1.0.0 running correct under ubuntu 10.4.

While installing I got an error bout a missing package mozjs that I'm
ignoring
(after reading some Web-Articles about that).

The couchdb is running, but ma testapp that runs with couchdb 0.10.0
doesnt.
A View-Request doesnt get any answer.

The reasn for me to change the couchdb-version was only the wish to have
jquery
1.4 runing. So my question is:
Is ist possible to change the content of /_utils/script/jquery to "update"
tp
jquery 1.4.2

Second Question: did anyone have installed couchdb 1.0.0 on ubuntu 10.4
without
errors

Wolfgang 



Asynchronous JS CouchDB API
Hi guys,

I could not find any asynchronous version of
http://localhost:5984/_utils/script/couch.js
(Perhaps I didn't search hard enough)
That's why I modified it to work asynchronously instead of
synchronously.

This makes it possible to use CouchDB in Qt's QML.
If you are interested, have a look at
http://github.com/manuels/Async-CouchDB-API

Cheers,
Manuel



Couchdb 0.11 and Ubuntu 10.04
Hi,
I have just installed couchdb 0.11 on ubuntu 10.04 following the wiki
instructions ( http://wiki.apache.org/couchdb/Installing_on_Ubuntu ).
It compiles fine, and it seems to work - I can get elements with the
id - but when I try to get elements through a view the request just
hangs. I've been waiting for at least 10 minutes while writing this
message and it's still hanging, yesterday at some point a got a
strange error back after some time (something like error: "unknown",
reason: "shutdown").
I made sure that all the permissions are ok, I recompiled it several
times, but nothing. I need 0.11 for the because it has the incremental
id.

-- Francesco


CouchDB on an old machine
Hi fellow relaxed users,


I'm planning to set up CouchDB in an old Linux box, but I'm wondering  
if it's not too old : 400Mhz PentiumII, 128Mb of RAM, ~1To of storage.

My app will manage around 10k documents, each of them will have ~7Mo  
of files attached. It will only be used by my family so I don't expect  
much traffic.

 From your own experiences, can it work?


Martin Kirchgessner


CouchDB stats
Hello,

I don't know how I ever found out about /_stats to view statistics of a
CouchDB instance, because I can't find anything on it in the wiki or The
Definitive Guide. Anyway, the data mostly speaks for itself, but I haven't
been able to figure out what 'current' and 'count' mean exactly. Can anyone
enlighten me? (I'm still running on 0.10 for now if that's relevant.)

Nils.

De informatie vervat in deze  e-mail en meegezonden bijlagen is
uitsluitend bedoeld voor gebruik door de geadresseerde en kan
vertrouwelijke informatie bevatten. Openbaarmaking, vermenigvuldiging,
verspreiding en/of verstrekking van deze informatie aan derden is
voorbehouden aan geadresseerde. De VPRO staat niet in voor de juiste en
volledige overbrenging van de inhoud van een verzonden e-mail, noch voor
tijdige ontvangst daarvan.


Re: CouchDB 1.0 retrospectives
On 15 Jul 2010, at 01:14, Jan Lehnardt wrote:

 
 On 15 Jul 2010, at 01:11, Will Hartung wrote:
 
> Heh -- ditto -- I thought someone might aggregate links for a one
time
> post, but not hook me up to some confounded soulless world
reaching
> info bot contraption! :)
 
 I actually subscribe to CouchDB-only feeds (except for Rick Ho's blog
because it is all awesome) and Damien of course, so it is still very
selective. I read planet CouchDB every day :)

Today I added: 

 Will Hartung
 Klaus Trainer
 Randall Leeds

Anyone else with a CouchDB-only posts feed on his/her blog?
(cc us### @ — Looking for blogs to link on http://planet.couchdb.org/)

Cheers
Jan



clucene and couchdb
Hi,

I am writing a clucene indexer for CouchDB, I have
update_notifications and _fti as a db handler working. I am using
stdout/stdin for the communication and it is looking good.

Looking at http://wiki.apache.org/couchdb/Full_text_search I see that
the index property in the design document is a javascript function and
I am wondering why? For views I can understand why you would want to
do an evaluation but for Lucene could we just use a JSON Path
reference?

Thoughts appreciated, since I am in C++ and SpiderMonkey is available
I could do an eval of the javascript, but it might be easier just to
parse the JSON path.

We will be putting this CLucene implementation in the public domain
once I have cleared the necessary internal paperwork.

CLucene is dual license (Apache and LGPL) and I am using Cajun (BSD)
for the JSON parsing so should I host this separately or take out a
JIRA ticket to have it included in CouchDB?

thanks,

Norman


Can't Run CouchDB 0.11 as Daemon
Hi Guys,

I've made CouchDB 0.11 on CentOS 5.3 X86_64 from source. The erlang
installed in /opt/erlang.
I've done all of instructions :
http://wiki.apache.org/couchdb/Installing_on_RHEL5
(except step 6)
I'm able to run CouchDB as normal , get Futon and run tests. But when try
to
run it as daemon as you can see in attached couch.log:

[Mon, 14 Jun 2010 14:49:14 GMT] [error] [<0.19.0>]
{error_report,<0.8.0>,
              {<0.19.0>,std_error,
               "File operation error: eacces. Target:
./couch_rep_sup.beam.
Function: get_file. Process: code_server."}}

[Mon, 14 Jun 2010 14:49:14 GMT] [error] [<0.19.0>]
{error_report,<0.8.0>,
              {<0.19.0>,std_error,
               "File operation error: eacces. Target: ./httpd_util.beam.
Function: get_file. Process: code_server."}}
...
erlang complains.

Best Regards,
-- afshin


CouchDB Relaxback
Couchers,

I finally got around to starting what I hope is a regular series of blog
posts that will help everyone keep tabs on what's happening in the
community.

The first CouchDB Relaxback is here:
http://blog.couch.io/post/843835847/couchdb-relaxback

I would love to get ideas for things I should cover. It can be anything
from a shout-out to people who've been helping out on Stack Overflow
(thanks Sam Bisbee and others, I hope I remember to do that shout out in
next week's post) to just letting the world know that you've deployed a
CouchApp.

Or maybe it's even bigger, like your web-site has migrated to CouchDB. Or
even just normal, like you wrote a tutorial about how to get started with
CouchDB and Eclipse.

Nothing is to big or to small to include in the Relaxback. But I
definitely need help to keep track of it all. So feel free to reply to this
thread or write me directly: jchr### @apache.org

Cheers,
Chris



CouchDB Clients?
I'm working on blog post about CouchDB clients for different languages
and I was hoping to get some help from the crowd on this one.

What CouchDB clients are available for each language?
What ones are good and well supported?
Which ones are just plain aweful?
Which languages/platforms just have plain bad HTTP support?

The wiki covers about 10% of the clients out there so I figured it was
best to just ask everyone.

-Mikeal


My first few days of using couchdb
I have been impressed with couchdb so far but I have now hit the first
problem 
that I cannot see how to resolve easily.

I have a few test documents with a photo attached to each. I want to tag
these 
photos so I have a field called tags. This tag field may contain 1 or many
tags.

For example:-

[ "holiday","camping"]
or
["holiday","skiing"]

I can easily create a view that allows me to search the tags with
?key="holiday" 
however I cannot work out how to select photos which contains both tag1
and 
tag2.

Any guidance would be appreciated.

Regards

Robin


      

Reporting in CouchDB
I need to write some reports on top of the data in my couch db
application.  My use case is a central database monitoring the data
coming in from a bunch of satellite sites, and they want to generate
aggregate reports on the data by site and by date range.

My current plan is to use a view with a complex key that includes the
site id and date the data came in, with the value being a dictionary
of contributions the data makes to each aggregate indicator in the
report.  Then my reduce function can just sum up the individual keys.

However, this will only generate reports with the granularity of a
single day out-of-the-box, which means I will need to do further
processing on the client side in order to aggregate the counts over
the entire range specified.

My question is -- is there any way to do this in one view via couchdb?
 My understanding is that the best aggregation I can do is get it down
to one value per key, so even though I am only using the keys to
specify start and end ranges and always want to return a full
aggregate with a single set of counts I still have to do the final
aggregation on the client side.

Sorry if this is unclear.  I'd be happy to clarify over mail or IRC if
necessary.

thanks,
Cory


Couchdb via java
I'm currently evaluating couchdb as a database for one of our web
applications.

This scenario requires couchdb to be used from java. Therefore I
downloaded couchdb-0.11.0 and couchdb4j-0.1.2.jar. 

I did install couchdb on my Windows-XP box and it runs fine:
	{"couchdb":"Welcome","version":"0.11.0"}
Then I inserted two simple documents and tried to "query" it with the
following java program:

Session s = new Session("localhost", 5984);
Database db = s.getDatabase("mydb");
ViewResults result = db.getAllDocuments(); 		
for (Document d : result.getResults()) {
	System.out.println("id:"+d.getId());	 // Oops
	String id = (String) d.get("id");
	System.out.println("id:"+id); 		// Here "id" is correct

	Document full = db.getDocument(d.getId());	
	System.out.println("Name:"+full.getString("name"));
}

Problem is that the document Ids are not returned. But the program
reports the proper id when getting the field directly. 

What gives?

/Axel

/Axel


AW: Couchdb via java
I tried jcouchdb and this worked ok.

Thanks for helping.

/Axel


NYC CouchDB this week
Two CouchDB events in two straight days. NYC is like heaven!

There is a CouchDB meetup tomorrow, Tuesday the 27th, in NYC at 7pm at
DBA,
41 First Avenue, New York City, NY. 10003. Between 2nd and 3rd Street.

And I will be speaking on Wednesday the 28th at the NYC NoSQL meetup.
http://www.meetup.com/nosql-nyc/calendar/14107119/

-Mikeal