Timeline


and

2010-10-05:

14:50 Ticket #63 (Make server process Kauri modules for the RowLog MQ and WAL processors) closed by bruno
fixed: Implemented in r4308.
14:49 Ticket #56 (Run only one RowLogProcessor per shard cluster wide) closed by bruno
fixed: Leader election for running the message queue row log processor was added …
14:43 Ticket #141 (Add testcase for indexer components (master/worker/fullbuild)) created by bruno
We should have an automated testcase for these components, to verify at …
14:40 Ticket #140 (Review indexer engine code for not eating InterruptedExceptions) created by bruno
One case I've noticed is VersionTag? which catches Throwables. This is …
14:38 Ticket #139 (IndexerMaster: assure assigned subscription IDs are unique) created by bruno
Right now the IndexerMaster? is not sure that the MQ subscription it …
14:35 Ticket #138 (Re-activate RowLogLocalEndToEndTest) created by bruno
This test is currently completely commented out since it was failing, see …
14:33 Ticket #137 (IndexerModel: review for correct ZK usage) created by bruno
IndexerModel? needs some review for its ZK usage. Especially not eating …
14:31 Ticket #136 (ZooKeeperItf: add method to add default watchers) created by bruno
Especially for watching connection-related state events, it is interesting …
14:29 Ticket #135 (IndexerWorker: review for correct ZK usage) created by bruno
The IndexerWorker? needs to be review for correct ZK usage, especially with …
14:28 Ticket #134 (ZkUtil.retryOperation implementation improvement) created by bruno
The current implementation of ZkUtil?.retryOperation is not very …
14:25 Ticket #133 (Implement all increment index update states) created by bruno
The index update states SUBSCRIBE_DO_NOT_LISTEN and DO_NOT_SUBSCRIBE still …
14:25 Ticket #132 (Error handling in indexer fullbuild map reduce job) created by bruno
We need to have a look at error handling in the fullbuild MR job. …
14:22 Ticket #131 (Parallel processing in the fullbuild mapreduce job) created by bruno
For similar reasons as in #130, the fullbuild mapreduce job should run …
14:21 Ticket #130 (IndexerWorker: start multiple listeners for each subscription) created by bruno
This should improve indexing throughput, which spends quite some time …
14:20 Ticket #129 (Upgrade to Avro 1.4) created by bruno
This is in the context of a wrapping of ConnectException? withing an …
13:34 Ticket #88 (Clean shutdown of the Lily node) closed by stevenn
fixed
13:27 Ticket #128 (Consistent approach for creating HBase schema) created by stevenn
09:41 Ticket #127 (Growing amount of Watchers on ZK by RowLogConfigurationManager) created by evert
Stopping and starting the RowLogProcessor? results in a growing amount of …
09:27 Changeset [4318] by bruno
Server process / REST itf: do not use a fixed port number for the HTTP …
09:26 Ticket #126 (Add logging to RowLog) created by evert
Add more informative logging to the RowLog? framework.
09:21 Ticket #125 (Refine RowLogMessageListenerMapping to listener level) created by evert
Currently the RowLogMessageListenerMapping? maps SubscriptionIds? to …
09:07 Ticket #124 (Use stateless, singleton ChannelHandlers in ...) created by evert
Let the RemoteListenersSubscriptionHandler? use stateless, singleton …
09:06 Changeset [4317] by bruno
Server process: activate the message queue row log processor on only 1 …
09:01 Ticket #123 (Create existing subscription should inform caller) created by evert
When calling the addSubscription method on RowLogConfigurationManager? it …
08:57 Ticket #122 (Update subscriptions on the RowLogConfigurationManager) created by evert
Add some calls to allow to update existing subscriptions on the …
08:55 Ticket #121 (Extend RowLogConfigurationManager for RowLog) created by evert
Extend the RowLogConfigurationManager? with calls for configuration of the …
08:40 Ticket #120 (ListenerId is used for either an id, or a host+port) created by evert
The RowLogConfigurationManager#addListener? call accepts a string as …
08:19 Ticket #119 (Consider renaming SubscriptionContext to RowLogSubscription) created by evert
The SubscriptionContext? is a value object describing the subscription that …
08:11 Ticket #118 (Review error handling in RowLog) created by evert
Review the errors that are thrown in and by the RowLog? and related …
07:52 Ticket #27 (Introduce AbstractRepository) closed by evert
wontfix: An AbstractRepository? class is not really needed here. It is ok like it is …

2010-10-04:

16:07 Changeset [4316] by bruno
Some test cleanup/fixes which makes the tests run for me without forkMode …
16:01 Changeset [4315] by bruno
Remove empty dir.
13:34 Changeset [4314] by bruno
Enable link index updating in the server process: * Moved …
13:03 Changeset [4313] by bruno
Move rowlog-impl dependency from indexer-engine to indexer-worker, since …
12:56 Changeset [4312] by bruno
Clean up remaining getId()/getMaxTries() methods in RowLogMessageListener?
12:38 Changeset [4311] by bruno
Indexer fullbuild MR job: - pass a dummy rowlog impl to the embedded …
12:19 Changeset [4310] by bruno
Google Guava became a HBase client dependency.
09:50 Ticket #117 (Test Lily against CDH-current) created by stevenn
Lily must install and run well against Cloudera Distribution for Hadoop …

2010-10-01:

16:21 Changeset [4309] by bruno
* RowLogLocalEndToEndTest?: temporarily commented out the whole test as it …
15:17 Ticket #64 (Pushing messages to listeners in other JVMs) closed by evert
fixed: The RowLogConfigurationManager? allows to define if the listeners of a …
14:55 Ticket #116 (Allow for a mix of local and remote RowLog listeners on a subscription) created by evert
The RowLogConfigurationManager? allows to define at subscription level if …
14:49 Ticket #49 (MQ should serve multiple listeners) closed by evert
fixed: The RowLogConfigurationManager? allows to register multiple listeners on a …
14:29 Ticket #66 (Notify RowLog and RowLogProcessor when consumers are (un-)registered) closed by evert
fixed: The RowLogConfigurationManager? allows to register subscriptions (formerly …
14:26 Ticket #52 (RowLog should not call the RowLogProcessor directly when new consumers are ...) closed by evert
fixed: The RowLogConfigurationManager? allows to register subscriptions (formerly …
14:10 Changeset [4308] by bruno
Adjust the Lily server node to the changes happening in rowlog-land: * …
13:46 Changeset [4307] by bruno
Move to latest HBase trunk with patch for HBASE-3064 (Long sleeping in …
13:30 Changeset [4306] by evert
RowLogConfigurationManager? should not close the zookeeper connection it …
12:34 Changeset [4305] by evert
RowLogConfigurationManager? now accepts a ZooKeeperItf? as parameter in its …
11:14 Changeset [4304] by bruno
Move MessageQueueFeeder? from repository-impl to rowlog-impl project, …
09:58 Changeset [4303] by evert
Pull Wal (RowLog?) instantiation out of HBaseRepository
09:49 Changeset [4302] by bruno
Improvements to ZooKeeper? usage within LilyClient?: - check on startup if …
08:38 Ticket #62 (Pull RowLog processor instantiation out of Repository) closed by evert
fixed: r4297
08:19 Changeset [4301] by evert
Rename ListenerClassMapping? to RowLogMessageListenerMapping?. Register …

2010-09-30:

16:06 Ticket #111 (Write ahead log secondary actions (= rowlog consumers) error handling) closed by evert
fixed: Subscriptions on a Rowlog can be ordered by giving them an order number. A …
16:04 Changeset [4300] by evert
Subscriptions on a Rowlog can be ordered by giving them an order number. A …

2010-09-29:

15:53 Changeset [4299] by bruno
Refactored the IndexerMaster? to better handle ZK disconnection/connection …
15:27 Changeset [4298] by evert
Also setup messageQueue and messageQueueProcessor in AvroRepositoryTest?
14:51 Changeset [4297] by evert
RowLog? subscriptions and listeners are configured through the …
14:03 Changeset [4296] by bruno
Fix indexing of deref values pointing to multivalue fields (needs …
10:05 Changeset [4295] by bruno
Publish an MBean for ZooKeeper? so that one can query what the ZK session …

2010-09-28:

16:19 Changeset [4294] by bruno
ZooKeeper?: * use either ZkUtil?.connect or StateWatchingZooKeeper?, not …
14:19 Changeset [4293] by bruno
ZkUtil?: removed the ZkPathCreationException? which was only used to wrap …
14:05 Changeset [4292] by bruno
Let ZkPublisher? reuse the global ZooKeeper? instance instead of …
13:34 Changeset [4291] by bruno
ZooKeeper? (re #33): - wait for connection to come up at start up (this is …
07:43 Changeset [4290] by bruno
ZooKeeper? related stuff: * IndexLocker?: handle unnoticed creation of the …

2010-09-27:

10:11 Changeset [4289] by bruno
ZkLock? + LeaderElection?: improve / fix behavior in case of connection …
07:55 Changeset [4288] by evert
Renaming and refactoring some RowLog? classes.

2010-09-24:

14:08 Changeset [4287] by bruno
Lily node HTTP port: switch from NIO to BIO Jetty connector, re #107.

2010-09-23:

13:55 Changeset [4286] by bruno
mbox-import readme: list some more mbox sources
07:51 Changeset [4285] by bruno
Indexer engine: test classes/resources were still in old package, moving …

2010-09-22:

16:57 Changeset [4284] by evert
Avoid creating too many workers and futures when there are no messages to …
16:20 Changeset [4283] by bruno
Introduce the record index lock (re #70). To avoid multiple parallel …
16:17 Ticket #115 (Indexer: handle record messages (events) in order) created by bruno
One of the reasons for designing the message queue (rowlog) with a 'local …
15:24 Changeset [4282] by evert
Move connecting to ZooKeeper? from RowLogConfigurationManager? to ZkUtil?
12:08 Changeset [4281] by evert
Avoid putting messages in the worker queue that are being processed at the …
10:13 Changeset [4280] by bruno
Add possibility to delete indexes: - if a batch build job is currently …

2010-09-20:

16:33 Changeset [4279] by evert
Giving RowLogConfigurationManager? more time to connect to Zookeeper
16:23 Changeset [4278] by evert
Added basic framework for using multiple remote listeners for one rowlog …
16:02 Changeset [4277] by bruno
Tests: enabling forkMode always, just to see if this would help with the …
13:22 Changeset [4276] by bruno
KauriTestUtility?: generate hbase.xml in new format, otherwise it has no …
12:30 Changeset [4275] by bruno
Upgrade to newer HBase trunk version.
12:21 Ticket #114 (HDFS blob storage: consider hierarchical directory layout) created by bruno
Currently all HDFS-stored blobs are stored within a single directory on …
12:15 Changeset [4274] by bruno
Repository: dfs blob store: store blobs in a specific directory rather …
10:07 Changeset [4273] by mpo
Allows to build these plugin-dependencies without the root-project being …
07:52 Changeset [4272] by bruno
Remove a temporary system.out.println

2010-09-16:

16:31 Changeset [4271] by bruno
Indexing MR job: skip deleted records when scanning, use actual HBase …
16:13 Changeset [4270] by bruno
Indexer admin cli tools: check that the specified SOLR shard URIs are not …
15:50 Changeset [4269] by bruno
Server process: align the hbase.xml conf with the mapreduce.xml one: this …
15:29 Changeset [4268] by bruno
Add indexer admin CLI tools to retrieve the indexerconf and shardingconf …
15:03 Changeset [4267] by bruno
Set svn:ignore props.
15:01 Changeset [4266] by bruno
LilyClient? fix: blobs were not written to the real DFS because the DFS URI …
14:23 Changeset [4265] by bruno
Bring some uniformity into the CLI tools and avoid code duplication …
12:48 Changeset [4264] by bruno
* Moved indexerconf from indexer-engine to indexer-model project. This …
09:33 Changeset [4263] by bruno
Indexerconf: move the active behavior, more specificaly the Value.eval() …

2010-09-15:

16:38 Changeset [4262] by bruno
ShardSelectorTest?: fix wrong paths to test files.
16:10 Changeset [4261] by bruno
HbaseProxy?: make sure HBaseTestingUtility uses a new datadir on each run.
14:55 Changeset [4260] by bruno
Indexer: introducing SOLR sharding. If you specify multiple SOLR shards …
14:13 Changeset [4259] by bruno
mbox import: fix error in schema, add some ideas for future improvements …

2010-09-14:

11:43 Changeset [4258] by bruno
Making the mbox import tool a bit more useful: - support importing .gz …
11:40 Ticket #113 (Indexer: handle blob extraction errors.) created by bruno
This is a specific case of #76 (indexer error handling). Some relation to …
09:35 Changeset [4257] by bruno
Uncomment indexer tests. Version tag 'last' now has special behaviour, …
09:32 Changeset [4256] by bruno
Upgrade to latest HBase.

2010-09-13:

16:43 Changeset [4255] by bruno
Add a tool for importing mbox mail archives into Lily. The purpose is to …
16:27 Changeset [4254] by bruno
Indexer: fix problem with tika not finding its parsers when running as …

2010-09-10:

12:05 Changeset [4253] by evert
Some code cleanup on HBaseRepository. And a few extra tests on updating …

2010-09-09:

14:40 Changeset [4252] by bruno
Point people to the docs.
14:34 Changeset [4251] by bruno
Move the sample indexerconf's to the indexer/admin-cli directory, as that …
14:22 Changeset [4250] by bruno
Redesigned the index state, it is now split into three different states: …
09:34 Changeset [4249] by bruno
IndexerMaster?: remove IndexModelListener? when diselected as master + …
07:58 Changeset [4248] by bruno
IndexerMaster?: instantiate MR job tracker client only when needed, so that …
07:50 Changeset [4247] by evert
Moving to HBase 0.89.0-r995337 which includes the fix for HBase-1485

2010-09-08:

16:07 Changeset [4246] by bruno
Adding index rebuilding: MapReduce? job and its triggering/followup by the …
12:37 Changeset [4245] by evert
Moving to 0.89.0-r993644-patch1485-v9 which is HBase 0.89.0-r993644 with …

2010-09-07:

14:27 Changeset [4244] by bruno
Set some svn:ignore props.
14:26 Changeset [4243] by bruno
* Added a project lily-hbase-client which is an empty wrapper project …

2010-09-06:

16:13 Changeset [4242] by bruno
* Extended HBaseRunner to also launch a mini MapReduce? cluster. * Add a …
08:38 Ticket #112 (Netty vs ZK for rowlog processor wakeup) created by bruno
Maybe it makes more sense to use ZK rather then Netty to trigger the …
08:35 Ticket #11 (Timezone-awareness of DATE PrimitiveValueType) closed by bruno
fixed: Decided the jodatime dependency is no problem. Since the chronology is …
08:31 Ticket #69 (Use senseful fixed default blob store configuration) closed by bruno
fixed: This has been implemented already: * on the server side in the Kauri …
08:27 Changeset [4241] by bruno
Add comment explaining reasoning for putting all properties of an index in …
08:01 Changeset [4240] by bruno
setting svn:ignore property
07:56 Ticket #111 (Write ahead log secondary actions (= rowlog consumers) error handling) created by bruno
The desired behavior for WAL secondary actions (sometimes) is that if one …

2010-09-05:

16:13 Changeset [4239] by bruno
Add json-util project which I forgot to add in 4237. Set some …
16:11 Changeset [4238] by bruno
Forgotten to add in previous commit.
16:07 Changeset [4237] by bruno
Started introducing the management around indexes. In this new design, …
Note: See TracTimeline for information about the timeline view.