Best unofficial Apache Server developers community |
Home >> discussions >> Apache Avro
Apache Avro Recent threads
| Threads | Replies | First post | Last post | |
|---|---|---|---|---|
|
Why is the String type a Schema property? By: Mark Hayes Hi, This is my first post to this list. I'm writing a binding API
for our database product, to allow users to easily store Avro binary
data in the database and use any of the built-in Avro object
representations (Generic, Specific, etc) as well…
|
4 | May 23 2012 23:11 |
May 24 2012 15:34 |
|
|
Can serialized Avro records be efficiently compared without deserializing? By: Jonathan Coveney Imagine I use Avro to serialize an object (without loss of generality
let's say an array of longs). I'm curious if it is possible to compare
those arrays without deserializing... ie look at the bytes in memory
or on disk, and do the comparison…
|
3 | May 22 2012 15:22 |
May 24 2012 01:14 |
|
|
eta for 1.7.x release? By: Alan Miller Hi, is there an ETA for AVRO 1.7.x release? Specifically, I'm
looking for a release with AVRO-593. I just started using Avro Java
bindings in my Hadoop (CDH3u3) project and I'm able to create my .avro
data files on HDFS (Hurrah!). Now I need to…
|
1 | May 21 2012 12:24 |
May 21 2012 18:19 |
|
|
how to get get field type By: Alan Miller I'm writng Avro files for time-related data (data-yyyy-mm-dd.avro)
via Java/HDFS and have approx 50 fields of various types. This all
works and I'm good there. But now, different people (various teams in
my organization) will be writing their own…
|
0 | May 21 2012 12:29 |
May 21 2012 12:29 |
|
|
using custom builders By: Joel VanderWerf Hi, I'd like to subclass the avro-generated classes. Is it
possible to tell avro to deserialize using a custom builder that
instantiates my subclasses? There are some hints in the source code
that this might be possible, but what I'd really…
|
0 | May 17 2012 13:55 |
May 17 2012 13:55 |
|
|
How to extract byte array from memoryOutputStream By: Gaurav Nanda I want to extract byte array from memoryOutputStream to transfer the
encoded data. How do I achieve that?
|
5 | May 10 2012 12:20 |
May 17 2012 11:36 |
|
|
Writing in Cpp and reading in Python By: Gaurav Nanda Hi, I am using following schema to write in C++ and reading in
python. { "type": "record", "name": "jok_obj", "fields" : [
{"name" : "val", "type": ["null", "boolean", "long", "int",
"double",…
|
3 | May 14 2012 16:12 |
May 15 2012 13:34 |
|
|
How to encode/decode java.util.Properties By: Stefan Schönig I'm not able to Encode/Decode a class from the Standard-JDK (
java.util.Properties). The inserted key/value pair is not available
after decode. Any idea what goint wrong?!? Thank in advance! Code
of the application: import…
|
1 | May 14 2012 10:09 |
May 15 2012 09:59 |
|
|
How represent abstract in Schemas By: Gavin YAO Hello: I am very new to the Apache Avro community so I hope I
am doing right in just sending a mail to this address. Is it
possible to represent abstract as in Java language we can do it by
abstract class or interface? Thanks a…
|
2 | May 6 2012 23:56 |
May 7 2012 21:57 |
|
|
Support for Serialization and Externalization? By: Joe Gamache This is a multi-part message in MIME format.Hello, We have been
using Avro successfully to serialize many of our objects, using
binary encoding, for storage and retrieval. Although the
documentation about the Reflect Mapping states: This…
|
2 | Apr 23 2012 12:38 |
May 4 2012 13:00 |
|
|
Nested schema issue (with "munged" invalid schema) By: Peter Cameron This is a multi-part message in MIME format.I'm having a problem with
nesting schemas. A very brief overview of why we're using Avro
(successfully so far) is: o code generation not required o small
binary format o dynamic use of schemas at…
|
2 | May 1 2012 11:55 |
May 2 2012 04:27 |
|
|
Nested schema issue By: Peter Cameron I'm having a problem with nesting schemas. A very brief overview of
why we're using Avro (successfully so far) is: o code generation not
required o small binary format o dynamic use of schemas at runtime
We're doing a flavour of RPC, and the…
|
1 | May 1 2012 11:48 |
May 1 2012 18:21 |
|
|
Specific/GenericDatumReader performance and resolving decoders By: Irving, Dave Hi, Recently I've been looking at the performance of avros
SpecificDatumReaders/Writers. In our use cases, when deserializing, we
find it quite usual for reader / writer schemas to be identical.
Interestingly, GenericDatumReader bakes in the use…
|
1 | Apr 19 2012 04:10 |
Apr 19 2012 11:21 |
|
|
Avro + Snappy changing blocksize of snappy compression By: snikhil0 I am experimenting with Avro and snappy and want to plot the size of
the compressed avro datafile as a function of varying compression
block size. I am doing this by setting the configuration value for
"io.compression.codec.snappy.buffersize".…
|
5 | Apr 18 2012 12:23 |
Apr 18 2012 16:28 |
|
|
AvroStorage/Avro Schema Question By: Russell Jurney Is it possible to name string elements in the schema of an array?
Specifically, below I want to name the email addresses in the
from/to/cc/bcc/reply_to fields, so they don't get auto-named
ARRAY_ELEM by Pig's AvroStorage. I know I can probably…
|
6 | Mar 29 2012 20:06 |
Apr 17 2012 21:31 |
|
|
New Apache Avro PMC Member: Douglas Creager By: Scott Carey The Apache Avro PMC is pleased to announce that Douglas Creager is
now part of the PMC. Congratulations and Thanks!
|
0 | Apr 10 2012 14:49 |
Apr 10 2012 14:49 |
|
|
Sync Marker Issue while reading AVRO files writen with FLUME with PIG By: Markus Resch Hey everyone, we're facing a problem while reading AVRO files
written with FLUME using the AVRO Java API 1.5.4 into a HADOOP
cluster. The Avro Data Store complains about missing sync marker.
Investigating the problem shows us, that's perfectly…
|
1 | Apr 3 2012 03:29 |
Apr 3 2012 11:23 |
|
|
read a compressed avro file By: Weishung Chung Hey avro users, Could you guide me to an example on how to read a
compressed avro file (snappy) ? Thank you, Wei Shung
|
4 | Mar 31 2012 00:34 |
Apr 3 2012 01:19 |
|
|
avro compression using snappy and deflate By: snikhil0 I must be doing something wrong: I am writing out avro files with
three options: a. no codec b. deflate codec c. snappy codec I am
measuring size of final avro file. In my observation, the snappy file
is larger than the original avro file? duh? …
|
5 | Mar 30 2012 02:44 |
Apr 2 2012 10:42 |
|
|
Code Generation from avsc files By: Deepak Nettem Hi, I have a .avsc schema file in my maven project, and I am able to
use it to write simple avro apps. However, I am not able to generate
source code (classes) from the avro schema file to be able to use them
in Avro MapReduce code. My pom.xml…
|
2 | Mar 30 2012 08:32 |
Mar 30 2012 09:04 |