Timeline


and

2010-07-30:

14:49 Changeset [4185] by evert
Added primitive types Double and Decimal. (#43)
08:48 Ticket #91 (Validate record against record type) created by evert
Create, update and delete operations on a record are validated against its …
08:12 Ticket #90 (WAL processor handles open WAL messages) created by evert
A WAL processor checks the RowLog? for any WAL messages. In normal …

2010-07-29:

16:01 Ticket #89 (Blob extracted content cache) created by bruno
When a record with blob fields needs to be reindexed, the content for …
15:50 Changeset [4184] by bruno
Move to newer HBase trunk snapshot.
15:49 Changeset [4183] by bruno
Remove needless filter, which brakes things with latest HBase.
13:58 Ticket #88 (Clean shutdown of the Lily node) created by bruno
Sometimes the Lily cannot be killed cleanly, but needs a kill -9. In such …
13:55 Ticket #87 (Perform 0.2 testing) created by bruno
Just a placeholder issue to record the fact that testing will be done for …
13:51 Ticket #86 (Linux deb/rpm/other packaging) created by bruno
Besides the binary release (#84) we might want to create Linux packages …
13:48 Ticket #85 (Puppet configuration scripts) created by bruno
We plan on looking a bit at puppet to configure our test servers for 0.2. …
13:40 Ticket #84 (Binary packaging of Lily (.tar.gz)) created by bruno
We should have a binary downloadable Lily, which includes: - everything …
13:28 Ticket #83 (Complete index rebuilding) created by bruno
It is important that the SOLR index can be rebuild from scratch, for …
13:26 Ticket #82 (Optimize processing of all outstanding event in the Indexer) created by bruno
When the Indexer receives a message for a record, it might be that in the …
13:24 Ticket #81 (Support record re-incarnation in indexer) created by bruno
If we would support the sequence {delete record with id X, create record …
13:22 Ticket #80 (Blob extraction options) created by bruno
A maximum size of blobs that can be fed to tika should be configurable, in …
13:20 Ticket #79 (Add limit for deref-values to prevent system overload) created by bruno
The automatic updating of denormalized data in the index is intended to be …
13:16 Ticket #78 (Link extraction from blob fields) created by bruno
13:15 Ticket #77 (Have a strategy for comitting the SOLR index) created by bruno
Not sure if we need one though, maybe this can be configured on the SOLR …
13:14 Ticket #76 (Handling error situations in the Indexer) created by bruno
The Indexer does not have meaningful error handling. This includes things …
13:12 Ticket #75 (The problem of lost updates in Lucene buffer) created by bruno
While we have a solid log and messaging infrastructure to be sure that for …
13:08 Ticket #74 (Routing towards different SOLR shards in the Indexer) created by bruno
The basics are quite simple: once the indexer decides to do an operation …
13:03 Ticket #73 (Discovery of available query endpoints by clients -- LilyClient.getSolr()) created by bruno
Currently we expect clients to perform queries by directly contacting …
12:59 Ticket #72 (Abstraction layer for performing queries (no direct SOLR use)) created by bruno
Currently we expect clients to directly perform queries on SOLR. There …
12:41 Ticket #71 (Publishing of repository availability in zookeeper should be optional.) created by bruno
Some Lily nodes might be configured to perform a dedicated function, for …
12:37 Ticket #70 (Indexer should lock record it is working on) created by bruno
When we run multiple indexers in parallel, no two indexers should …
12:13 Ticket #69 (Use senseful fixed default blob store configuration) created by bruno
While awaiting a real configuration of the blobstore (see #31), we should …

2010-07-28:

13:00 Ticket #68 (Assure RowLog stays usbale outside of Lily) created by evert
Keep technical docs and javadoc up to date
12:30 Ticket #67 (Buffering of RowLogProcessor wakeup notifications) created by evert
The RowLogProcessor? checks for any messages to be processed by a consumer. …
12:00 Ticket #66 (Notify RowLog and RowLogProcessor when consumers are (un-)registered) created by evert
While Lily is up and running, RowLogConsumers? can be registered and …
09:08 Ticket #65 (Perform testing to determine importance of multiple RowLog shards) created by evert
The current RowLog? implementation allows for multiple shards to be present …
09:03 Ticket #64 (Pushing messages to listeners in other JVMs) created by evert
As described in #49 , a MQ consumer should be able to forward messages to …
08:37 Ticket #63 (Make server process Kauri modules for the RowLog MQ and WAL processors) created by evert
The RowLogProcessors? for the MQ and WAL should be configured and started …
08:22 Ticket #62 (Pull RowLog processor instantiation out of Repository) created by evert
Launching the RowLogProcessor? for the MessageQueue? (and WAL) currently …

2010-07-27:

13:26 Changeset [4182] by evert
The RowLog? connections to ZooKeeper? and to the Processor over Netty now …
08:27 Ticket #36 (Consider making the repository and type manager available over the same ...) closed by bruno
fixed: The repo & type manager avro protocols were merged in r4119 to avoid the …

2010-07-26:

08:44 Ticket #6 (FieldType <null> already exists) closed by bruno
fixed: This seems to have been fixed in r4041.

2010-07-23:

13:42 Ticket #39 (Hardcoded 'lat-kind' hostname in server process services.xml) closed by bruno
fixed
13:25 Changeset [4181] by bruno
Remove unused old directory.
11:40 Ticket #61 (Fully-distributed setup) created by stevenn
Don't know if this is too big an issue to file as one, but the idea is to …
11:31 Ticket #60 (Figure out some non-Avro way to talk with Lily) created by stevenn
You know, like JSON over HTTP, some kind of REST service if you want, and …

2010-07-22:

09:28 Changeset [4180] by bruno
Finally got the maven site generation to work completely, the empty index …

2010-07-21:

16:52 Changeset [4179] by bruno
Update version numbers.
16:50 Changeset [4178] by bruno
Deploy maven-site (javadocs) at a versioned URL. Had a lot of trouble …
13:47 Changeset [4177] by bruno
[maven-release-plugin] prepare for next development iteration
13:46 Changeset [4176] by bruno
[maven-release-plugin] copy for tag RELEASE_0_1_0
13:46 Changeset [4175] by bruno
[maven-release-plugin] prepare release RELEASE_0_1_0
13:17 Changeset [4174] by bruno
setting svn:ingore's
12:49 Changeset [4173] by bruno
Use non-snapshot version of Avro Maven plugin.
12:18 Changeset [4172] by bruno
Switching to Maven's SNAPSHOT-version number scheme.
12:07 Changeset [4171] by bruno
root pom: add license & scm sections (scm is needed by release plugin)
11:52 Ticket #59 (Bring uniformity in naming of HBase tables and column families) created by bruno
We have table names with dashes, with camelcase, long table names, short …
11:46 Ticket #58 (Querying in a certain vtag-view requires to know ID of vtag field) created by bruno
Suppose you want to launch a query on SOLR where you only want to search …
11:26 Changeset [4170] by bruno
Remove unused imports.
11:22 Changeset [4169] by bruno
Adding license headers.
11:21 Changeset [4168] by bruno
Adding license headers
08:28 Changeset [4167] by bruno
Sleeping in the consumer thread: change the while back to an if: seems …

2010-07-20:

13:38 Changeset [4166] by bruno
Small metrics change, check thread interrupted state before processing …
13:36 Changeset [4165] by bruno
Set up logging for HBaseRunner, especially disable the …
13:34 Changeset [4164] by bruno
fix metrics code
13:34 Changeset [4163] by bruno
* Do not unregister IndexUpdater? as rowlog consumer, otherwise can't shut …
12:45 Ticket #57 (Support multiple RowLogShards) created by evert
Working with only one RowLogShard? could cause one HBase region to become a …
12:31 Ticket #56 (Run only one RowLogProcessor per shard cluster wide) created by evert
In a distributed setting, only one of the Lily nodes should run a …
10:58 Ticket #55 (The repository should check if the WAL contains any unfinished tasks) created by evert
Upon receiving a CRUD operation, the repository should check if the WAL …
10:51 Ticket #54 (Get all open messages for a consumer from the RowLog) created by evert
In the context of the MessageQueue?, a consumer should be able to bundle …
09:32 Changeset [4162] by bruno
fix bug
09:30 Ticket #53 (Clean remaining messages when unregistering a consumer) created by evert
When a consumer is unregistered from the rowlog, any not-yet-processed …
09:23 Changeset [4161] by evert
Updated some javadoc on registering and unregistering …

2010-07-19:

16:37 Changeset [4160] by evert
The RowLogProcessor? picks up any RowLogConsumers? that are registered or …
16:33 Ticket #52 (RowLog should not call the RowLogProcessor directly when new consumers are ...) created by evert
When consumers are registered or unregistered while Lily is running and …
14:53 Ticket #45 (Update tutorial) closed by bruno
fixed
13:45 Changeset [4159] by bruno
Fix wrong location hbase.xml.
13:29 Changeset [4158] by bruno
Rename class Client to LilyClient?.
13:27 Changeset [4157] by evert
RowLogProcessor? uses a table scanner now to retrieve 100 messages instead …
09:53 Changeset [4156] by evert
Increase RowLogProcessor? wait time to 5sec Make sure …
09:12 Changeset [4155] by bruno
comments
09:12 Changeset [4154] by bruno
Repository.getVariants(): filter out rows marked as deleted.
09:11 Ticket #51 (Metrics improvements) created by bruno
Seems like some of the more interesting functionality of hadoop's metrics …
07:30 Changeset [4153] by bruno
Removing empty projects directory.
07:29 Changeset [4152] by bruno
Removing the historic "/projects/lily" location from the SVN repository.
07:29 Changeset [4151] by bruno
Removing the historic "/projects/lily" location from the SVN repository.
07:27 Changeset [4150] by bruno
Removing the historic "/projects/lily" location from the SVN repository.
07:25 Changeset [4149] by bruno
Adding metrics using Hadoop's metrics package. Added metrics to: …

2010-07-16:

14:36 Ticket #50 (The table of a RowLogShard should inlcude the RowLog's Id in it's name) created by evert
The table created for a RowLogShard? should not only include the shard's id …
14:27 Ticket #49 (MQ should serve multiple listeners) created by evert
The Message Queue RowLogConsumer? should be able to have multiple listeners …
14:19 Ticket #48 (Add process to clean up deleted records) created by evert
When a record is deleted it is flagged as deleted. Any CRUD operations …
12:18 Changeset [4148] by evert
Delete of a record now puts a deleted-flag and avoids that Rowlog …

2010-07-15:

13:40 Changeset [4147] by bruno
Delete old dir.
13:38 Changeset [4146] by bruno
Rename package org.lilycms.repoutil to org.lilycms.util.repo
12:55 Changeset [4145] by bruno
Fix threadsafety problem.
12:53 Changeset [4144] by bruno
Tester: in case all creates would have failed, there would be no records …
12:19 Changeset [4143] by bruno
Fix things in testcases after HTable -> HTableInterface move. I always …
12:00 Changeset [4142] by bruno
initial commit
12:00 Ticket #19 (Repository & thread safety) closed by bruno
fixed: (In [4141]) * Start replacing non-threadsafe use of HTable by LocalHTable …
12:00 Changeset [4141] by bruno
* Start replacing non-threadsafe use of HTable by LocalHTable which is an …
11:58 Changeset [4140] by bruno
Add missing AvroGenericException? declaration for delete method.

2010-07-14:

16:12 Changeset [4139] by bruno
Avro: if non-checked exceptions happen, propagate those over avro as …
13:21 WikiStart edited by stevenn
(diff)
09:42 Changeset [4138] by evert
Putting JBoss Nexus repository (used for Netty) next to JBos Maven2 …
07:38 Changeset [4137] by evert
RowLog? now uses separate threads for each consumer. The threads go in wait …

2010-07-12:

11:47 Changeset [4136] by bruno
Books sample: sample of deref field in indexer.
11:46 Changeset [4135] by bruno
Import tool: support an option such that only the schema part of the …
11:43 Changeset [4134] by bruno
Fix NPE.
11:42 Changeset [4133] by bruno
RecordNotFoundException? could have been thrown in cases where the record …
08:02 Changeset [4132] by bruno
An import file that creates a record with 1000 versions, just to check …

2010-07-09:

15:16 Ticket #47 (vtag: set to last version problem) created by bruno
Often when updating a record, one might want to set a vtag to the latest …
14:38 Changeset [4131] by bruno
Adding 'books sample': * sample import file * matching sample indexer …
12:18 Changeset [4130] by bruno
Import tool: * add support for non-string value types (all except blob) …

2010-07-08:

14:22 Changeset [4129] by bruno
Set some svn:ignore's
14:19 Changeset [4128] by bruno
Tester: check for exact number of cli arguments.
14:19 Changeset [4127] by bruno
Import tool: allow to specify zookeeper connect string as cli arg, add …
13:57 Changeset [4126] by bruno
Move import tool to tools dir.
13:52 Changeset [4125] by bruno
New 'Tester' tool: this is a tool for performing simple load testing. It …
12:53 Changeset [4124] by evert
Leaving it up to the shard implementation to split a message over …
07:27 Changeset [4123] by bruno
Removing throws clauses which became unnecessary by the removal of the …

2010-07-07:

14:35 Changeset [4122] by bruno
AvroConverter?: when deserializing records, do not rely on the TypeManager?
13:32 Changeset [4121] by bruno
Putting in stuff for the communication of exception causes and their …
10:13 Changeset [4120] by bruno
Previous changes to avro protocol and the merge of the two of them (with …

2010-07-06:

14:25 Changeset [4119] by bruno
Avro communication: ran into the problem that between the repository and …
07:32 Ticket #46 (Propagation of remote stacktraces and nested exceptions) created by bruno
The current Avro-based RPC assures that exceptions that are thrown by the …
07:31 Ticket #38 (Improve speed of testcases that make use of HBaseTestingUtility) closed by bruno
fixed: This has meanwhile been fixed, see the HBaseProxy class.
07:03 Changeset [4118] by bruno
Add some tests for Link.from/toBytes, fix a bug revealed by this.

2010-07-05:

16:26 Changeset [4117] by bruno
Improve the bytes representation of Link: instead of simply basing it on …
15:08 Changeset [4116] by bruno
* Rework exceptions as proposed in #17: make Repository(Runtime)Exception …
12:55 Changeset [4115] by bruno
Move to newer Kauri version. Problems relating to conflicting versions are …
07:57 Changeset [4114] by bruno
Lily server process: * Add an indexer kauri module and make it listen to …

2010-07-02:

09:12 Changeset [4113] by bruno
Trigger updating of link index as part of the index updater, rather than …
08:10 Changeset [4112] by bruno
HBaseRunner: uberusability: when started, print Java snippet to create …

2010-07-01:

12:04 Changeset [4111] by bruno
* Update to newer HBase snapshot (0.21.0-r959305), and corresponding …

2010-06-30:

11:31 Changeset [4110] by bruno
Split the Indexer into two: * the IndexUpdater?: the part that listens to …
09:51 Changeset [4109] by bruno
Tests were failing with a somewhat mysterious "NoClassDefFoundError?: null" …
Note: See TracTimeline for information about the timeline view.