multi-project directory structure

Hi,

Have a look at the new HiveColumnarLoader (pig 0.8.0) implementation in
piggy bank. It uses to classes which I kept separated from the loader
itself to support partition loading. The only thing is the partitions need
to have the folder name forma key=value

E.g

Date partitions:
/logs/date=2010-08-14
/logs/date=2010-08-15



----- Original Message -----
From: Arun A K <arnkr### @gmail.com>
To: pig-us### @hadoop.apache.org <pig-use### @hadoop.apache.org>
Sent: Wed Aug 18 19:35:46 2010
Subject: Load multiple files from a date range (available in the directory
structure)

Hi

I have the following scenario-

Pig version used 0.70

Sample HDFS directory structure:
/user/training/test/20100810/<data files>
/user/training/test/20100811/<data files>
/user/training/test/20100812/<data files>
/user/training/test/20100813/<data files>
/user/training/test/20100814/<data files>

As you can see in the paths listed above, one of the directory names is a
date stamp.

Problem: I want to load files from a date range say from 20100810 to
20100813.

I can pass the 'from' and 'to' of the date range as parameters to the Pig
script but how do I make use of these parameters in the LOAD statement. I
am
able to do the following
temp = LOAD '/user/training/test/{20100810,20100811,20100812}' USING
SomeLoader() AS (...);

But how do I make use of the parameters to the Pig script? Do I need to
make
use of a higher language like Python to capture all date stamps in the
range
and pass them to LOAD as a comma separated list?

Thanks for your time.

cheers
Arun A K
Graduate Student
Department of Computer Science
Indiana University, Bloomington

     [
https://issues.apache.org/jira/browse...nels:all-tabpanel
]

Carl Steinbach updated HIVE-91:

Hi

I have the following scenario-

Pig version used 0.70

Sample HDFS directory structure:
/user/training/test/20100810/<data files>
/user/training/test/20100811/<data files>
/user/training/test/20100812/<data files>
/user/training/test/20100813/<data files>
/user/training/test/20100814/<data files>

As you can see in the paths listed above, one of the directory names is a
date stamp.

Problem: I want to load files from a date range say from 20100810 to
20100813.

I can pass the 'from' and 'to' of the date range as parameters to the Pig
script but how do I make use of these parameters in the LOAD statement. I
am
able to do the following
temp = LOAD '/user/training/test/{20100810,20100811,20100812}' USING
SomeLoader() AS (...);

But how do I make use of the parameters to the Pig script? Do I need to
make
use of a higher language like Python to capture all date stamps in the
range
and pass them to LOAD as a comma separated list?

Thanks for your time.

cheers
Arun A K
Graduate Student
Department of Computer Science
Indiana University, Bloomington

     [
https://issues.apache.org/jira/browse...nels:all-tabpanel
]

Bruce Mitchener updated AVRO-230:

     [
https://issues.apache.org/jira/browse...nels:all-tabpanel
]

David Bosschaert resolved ARIES-353.

     [
https://issues.apache.org/jira/browse...nels:all-tabpanel
]

David Bosschaert reassigned ARIES-353:

I've installed Apache HTTP 2.2 on Win 7.
I am a real newcomer to web servers, etc.

As a learning exercise, I want to be able to enter 
http://localhost/doc or some variant of that and 
then be able to browse the docs in manual/

I put this in httpd.conf:

Alias /doc/ "C:/Program Files/Apache Software
Foundation/Apache2.2/manual/"
<Directory "C:/Program Files/Apache Software
Foundation/Apache2.2/manual/">
    Options Indexes FollowSymLinks MultiViews
    AllowOverride all
    Order allow,deny
    Allow from all
</Directory>

I've tried putting an .htaccess file in C:/Program Files/Apache Software
Foundation/Apache2.2/manual
with various options related to Content Negotiation, but
http://localhost/doc 
just shows me the text of index.html which appears to be a typemap file.

http://localhost/doc/index.html.en displays the 1st page of the doc, but
when I click
on a link the content of an .html (typemap?) file is displayed instead the
appropriate 
html.en file.

How can I make this mechanism work?

Thanks,
Ken

i use osrube(CMS) in centos that has folder in video files. i want give
login user to download that video files. but that folder can't access
without permission to users like url or ftp access. how can do this in
using
php

camel-jetty  can't config the temp directory for the multi part form
support rightly

Sorry that should have said CXF 2.2.9.
The commit is good, the message has the typo.

Unfortunately no
 svn commit --amend
yet...

David

On 16 July 2010 13:46,  <davi### @apache.org> wrote:
 Author: davidb
 Date: Fri Jul 16 12:46:10 2010
 New Revision: 964787

 URL: http://svn.apache.org/viewvc?rev=964787&view=rev
 Log:
 Move DOSGi to CXF 2.0.9
 - This commit includes Sergey's work to pick up CXF 2.0.9
 - It moves the CXF bundle to the end of the list of bundles
 - And adds the proper start levels to the system tests

 Modified:
    cxf/dosgi/trunk/distribution/multi-bundle/pom.xml
  
 cxf/dosgi/trunk/distribution/multi-bundle/src/main/resources/distro_bundles.xml
    cxf/dosgi/trunk/distribution/single-bundle/pom.xml
    cxf/dosgi/trunk/parent/pom.xml
  
 cxf/dosgi/trunk/systests2/multi-bundle/src/test/java/org/apache/cxf/dosgi/systests2/multi/TestExportService.java
  
 cxf/dosgi/trunk/systests2/multi-bundle/src/test/java/org/apache/cxf/dosgi/systests2/multi/TestImportService.java

 Modified: cxf/dosgi/trunk/distribution/multi-bundle/pom.xml
 URL:
http://svn.apache.org/viewvc/cxf/dosg...787&view=diff
 

I also wondered how to deal with those duplicate checks.

On one side it would be nice to do the checks in the interceptor chain
because then the checks don't need to be implemented for each backend.

However I think it is right that each backend does these checks
because the backend must protect itself and should not accept invalid
data.

Kind Regards,
Stefan


On Tue, Jun 15, 2010 at 5:58 PM,  <elech### @apache.org> wrote:
 Author: elecharny
 Date: Tue Jun 15 15:58:46 2010
 New Revision: 954942

 URL: http://svn.apache.org/viewvc?rev=954942&view=rev
 Log:
 Removed the checks for existence in the Exception interceptor, as
those checks are already done in the backend.

 Modified:
  
 directory/apacheds/trunk/core/src/main/java/org/apache/directory/server/core/exception/ExceptionInterceptor.java
  
 directory/apacheds/trunk/xdbm-partition/src/main/java/org/apache/directory/server/xdbm/AbstractStore.java

 Modified:
directory/apacheds/trunk/core/src/main/java/org/apache/directory/server/core/exception/ExceptionInterceptor.java
 URL:
http://svn.apache.org/viewvc/director...942&view=diff
 

Author: elecharny
 Date: Tue Jun  1 09:34:19 2010
 New Revision: 949974

 URL: http://svn.apache.org/viewvc?rev=949974&view=rev
 Log:
 Fixed another system dependent file creation : using '/' won't work
on windows
   
Sorry, my fault. I didn't consider that this may cause problems on
windows.

Kind Regards,
Stefan

 Modified:
    
directory/apacheds/trunk/xdbm-search/src/test/java/org/apache/directory/server/xdbm/GenericIndexTest.java

 Modified:
directory/apacheds/trunk/xdbm-search/src/test/java/org/apache/directory/server/xdbm/GenericIndexTest.java
 URL:
http://svn.apache.org/viewvc/director...974&view=diff
 

On Fri, Jun 4, 2010 at 8:56 PM,  <fel### @apache.org> wrote:
 Author: felixk
 Date: Fri Jun  4 17:56:57 2010
 New Revision: 951512

 URL: http://svn.apache.org/viewvc?rev=951512&view=rev
 Log:
 Probably vice versa

 Modified:
  
 directory/apacheds/trunk/core-api/src/main/java/org/apache/directory/server/core/filtering/CursorList.java

 Modified:
directory/apacheds/trunk/core-api/src/main/java/org/apache/directory/server/core/filtering/CursorList.java
 URL:
http://svn.apache.org/viewvc/director...512&view=diff
 

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Can please some cross check this? It doesn't has a testcase to verify it.

Thanks
Felix


On 06/04/10 20:07, fel### @apache.org wrote:
 Author: felixk
 Date: Fri Jun  4 18:07:07 2010
 New Revision: 951513
 
 URL: http://svn.apache.org/viewvc?rev=951513&view=rev
 Log:
 I don't believe that this ever has work that way
 
 Modified:
    
directory/apacheds/trunk/core/src/main/java/org/apache/directory/server/core/DefaultDirectoryService.java
 
 Modified:
directory/apacheds/trunk/core/src/main/java/org/apache/directory/server/core/DefaultDirectoryService.java
 URL:
http://svn.apache.org/viewvc/director...513&view=diff
 

Hi,

First my configuration:  Ubuntu 9.10 Desktop, Tomcat 6.0.20.

I have a Java servlet (MyServlet) and from within that servlet I need to
access a directory containing data files.  The Tomcat directory structure
is like this:

tomcat
    webapps
        MyServlet
    DataFiles
        data1.xml
        data2.xml

On reading through various posts, I'm somewhat confused as to the best way
(or any way, best, secure or otherwise) to access my data XML files via my
servlet.

One method I have found is to define a context.xml file under the
servlet's META-INF directory and within specify (somehow) the path of the
DataFiles directory.  Something such as:  

    <Context path="../DataFiles" docBase=""  />

In this case, does this also allow access from any HTTP user?  Basically I
just want the servlet to read/write to this directory and not
anyone/anything else.  I've not manage to get this going, so I'm not sure
if Context Path is the right solution for what I'm trying to achieve.

The second method I've found is to add a grant line to catalina.policy
file.  Is this the right way to go?

Surely there is a way to access a directory outside of the webapps
directory (as I don't want to place the DataFiles directory into the
MyServlet directory - want to keep code and data separate).

Many thanks in advance!


Cheers,

Bernard.
 		 	   		  

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Thanks Emmanuel.
I just wonder, how the maven run could pass without problems ...

 o Removed two annotations from classes that are not tests : they were
producing errors when run in eclipse
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.15 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAkwPjuEACgkQ2lZVCB08qHEMQgCfQ+vLliCuKBWg/EWKQs4+09Op
9YIAoItwJOYy0yX3r6MTp8mTeaQZfWhG
=MuTv
-----END PGP SIGNATURE-----

On 6/4/10 9:50 AM, feli### @apache.org wrote:
 Author: felixk
 Date: Fri Jun  4 07:50:56 2010
 New Revision: 951314

 URL: http://svn.apache.org/viewvc?rev=951314&view=rev
 Log:
 Don't catch RuntimeExceptions accidentally
    

Good 'catch' :-)

  btw, there are many places where we throw NullPointerExceptions 
(mainly when checking the methods arguments, which is wrong : we should 
throw a IllegalArgumentException instead).

I've been playing with Erlang views on and off in CouchDB, and find the
information on the internal Erlang structure of Docs lacking. Is there
somewhere I can read up on this? I had initially assumed that a Doc was a
list of tuples, but I am starting to suspect that I am wrong.

Mike

Hello everybody!

We have puppet infrastructure integrated with ldap. I can pass
different variables via puppetVars attribute in ldap.
Currently, I need to write puppet class to configure mod_proxy server.
mod_proxy servers has 5-10 configured sites. Every site configuration
has some variables: site name, listen port, destination site name,
destination port, protocol..
Does anybody has an idea, how can I place all this variables out of
puppet classes? In ldap? Or maybe puppet have some internal database,
like chef?

I am getting an odd error in my data from my broker. Using perl I am
changing
a map message to json using jms-map-json. This returns an improperly
structured version of my data.



'map' => [
                     {
                       'entry' => [
                                    {
                                      'string' => [

As you can see it is creating an array where the hash should be.

I now have to access data like @{@{$json->{map}}[0]->{entry}}; Which
is very
unpleasant. We did not have this issue prior. I used to be able to simply
do

@{$json->{map}{entry}} to access my data


This is with amq 5.3.2