2010-04-22 Martyn Russell <martyn@lanedo.com>

Updated NEWS

tracker-extract: Fixed double free in Vorbis extractor

2010-04-22 Carlos Garnacho <carlosg@gnome.org>

TrackerMinerFS: always set current_parent in ensure_mtime_cache()

2010-04-22 Philip Van Hoof <philip@codeminded.be>

Revert "libtracker-db: Fixed a problem with sqlite3_interrupt usage"
This reverts commit f47c31e7f2eff26a30e469bafc01f976741c244a.

Using the 'fix' I get sporadic endless loops where the stmt never goes out
of SQLITE_INTERRUPTED

2010-04-22 Martyn Russell <martyn@lanedo.com>

Bumped version

2010-04-22 Amit Jain <ext-amit.1.jain@nokia.com>

Functional Tests: Updated to allow writeback completion before extracting

Functional Tests: Operations of files in multilevel subfolders added

2010-04-22 Martyn Russell <martyn@lanedo.com>

Updated NEWS

2010-04-22 Carlos Garnacho <carlosg@gnome.org>

TrackerDBInterfaceSqlite: do sanity check on is_parent() and is_descendant().

TrackerDBInterfaceSqlite: Check more carefully for is_parent().
Be more intelligent about trailing slashes and don't take exact string matches as a positive.

Use tracker:uri-is-descendant() in recursive delete operations.

TrackerMinerFS: Get rid of slash_uri in queries where we use tracker:uri-is-*()
This is already handled in these functions, so no need for that check in the miner.

TrackerMinerFS: Improve condition in ensure_iri_cache().

Remove \n from g_debug and g_criticals.

TrackerMinerFS: Make mtime/iri caches query per folder through tracker:uri-is-*().
Also, the query to get all children on directory moving is done through tracker:uri-is-descendant().

TrackerSparqlExpression: add tracker:uri-is-parent/descendant() sparql functions.

TrackerDBInterfaceSqlite: Add functions to deal with URIs hierarchy.
SparqlUriIsParent and SparqlUriIsDescendant have been added, taking 2 URIs and
returning true if the second is a direct/indirect child of the former.

TrackerMinerFS: Cache URNs for the processed files.
This cache is cleared on processing directory change, late additions are also
handled, as well as cache invalidation on files being moved/deleted.

TrackerMinerFS: Do not query parent URN frequently if it doesn't exist.
This is specially visible in the applications miner, since the container
directories aren't actually stored.

TrackerMinerFS: Perform one mtime query per folder.
Now that crawling/processing order is guaranteed to have all items
in one folder to be handled together, perform a mtime query per folder,
and compare against these results.

2010-04-22 Philip Van Hoof <philip@codeminded.be>

libtracker-db: Fixed a problem with sqlite3_interrupt usage

tracker-search-bar: Comparison with unsigned integer (enum) is always true

tracker-extract: Compilation warning fix

NFO: Add an index on nfo:fileLastModified for miner-fs's crawling performance

2010-04-21 Jorge González <jorgegonz@svn.gnome.org>

Updated Spanish translation

2010-04-21 Aleksander Morgado <aleksander@lanedo.com>

Fixes GB#616165: Improved reading PS and PS-GZ files
* Don't use a temporary file for the uncompressed ps-gz file contents
* Re-use the same buffer when iterating each line in the ps extractor, no need
to allocate a new one each time.
* Stop reading the uncompressed PS file if reached a max limit (same previous
limit of 20MBytes is used, just a safe one)

Fixes GB#616403 - Improve & fix reading msoffice/powerpoint files
Bugfixes:
* CharsAtoms now read as CharsAtoms; and BytesAtoms read as BytesAtoms.
* UTF-16 string converted to UTF-8 before normalizing
* Fix the Invalid Reads as now generated UTF-8 string comes NIL-terminated

Improvements:
* Stop reading when max bytes reached
* Re-use buffer for reading

2010-04-21 Martyn Russell <martyn@lanedo.com>

Merge branch 'async-queries-due'

2010-04-21 Aleksander Morgado <aleksander@lanedo.com>

Fixes GB#616329: Improve and fix reading msoffice/excel files
* Strings which are split into two ExcelExtendedStringRecord are now properly read.
* String contents are now converted from CP1252 or UTF-16 to UTF-8
* Reading the string is now done in either 1 or 2 GSF reads, not byte per byte.

* Limited the max number of bytes to be read from the stream, to the common safe
limit of 3*max_words*max_word_size.
* Contents are now normalized and word-counted in a buffered way.
* Stop reading the contents when max bytes reached.
* Stop reading the contents when max number of words reached.

2010-04-21 Martyn Russell <martyn@lanedo.com>

libtracker-miner: Don't translate statuses
This also adds a tracker-status -s to list common statuses

2010-04-20 Aleksander Morgado <aleksander@lanedo.com>

Fixes GB#615948 - Improved reading msoffice/xml files
* Don't use heap to store the whole output of libgsf, use just a buffer
in stack, and read & parse in a buffered way.
* Limit to 20MBytes the max of bytes which could be read from the
uncompressed XML file.

2010-04-20 Tshepang Lekhonkhobe <tshepang@gmail.com>

tracker-sparql: Fixed typo in man page for command line args

tracker-control: Added --reindex-mime-type and --start options to man page docs

2010-04-20 Carlos Garnacho <carlosg@gnome.org>

Move nfo:isContentEncrypted to be defined in 33-nfo.ontology.

tracker-extract-pdf: set nfo:isContentEncrypted for encrypted docs.

2010-04-20 Aleksander Morgado <aleksander@lanedo.com>

Fixes GB#616158/doc: Improve reading msoffice doc files
* Limit the max number of bytes to be read from the stream, to some safe
limit like 3*max_words*max_word_size.
* Don't load the whole doc in heap: use a buffer to read the contents, convert
to UTF-8, perform normalization and word count (chunk by chunk).
* Stop reading the contents when max bytes reached.
* Stop reading the contents when max number of words reached.

2010-04-20 Mikael Ottela <mikael.ottela@ixonos.com>

Fixes bug 161964 - Some special audio files are not displayed in the Music..
Try to check whether a mp4 file is actually only audio, not video.

2010-04-19 Carlos Garnacho <carlosg@gnome.org>

tracker-extract-html: Improve <script> bypassing.

Bug 615856 - add html content extraction
Add simple parser for text inside <body>. The skipping of JS scripts is a bit
weak (also given faulty html pages hoping for a forgiving browser), but that's
something that may be improved in the future.

2010-04-18 Andrej Žnidaršič <andrej.znidarsic@gmail.com>

Updated Slovenian translation

2010-04-18 Philip Van Hoof <philip@codeminded.be>

libtracker-db: O_LARGEFILE must be added to the g_open of the journal

2010-04-16 Jorge González <jorgegonz@svn.gnome.org>

Updated Spanish translation

2010-04-16 Jürg Billeter <j@bitron.ch>

libtracker-db: Add missing include

libtracker-db: Shutdown FTS in all threads before DB interface shutdown

2010-04-16 Carlos Garnacho <carlosg@gnome.org>

tracker-db-manager: Remove interfaces from hashtable as soon as the thread finalizes.

tracker-db-manager: Add NULL check when destroying thread/iface hashtable.
tracker_db_manager_init() may return early in some circumstances, not creating
the hashtable.

2010-04-16 Jürg Billeter <j@bitron.ch>

tracker-store: Allow running 2 queries in parallel

libtracker-fts: Fix crash on thread cleanup
Do not depend on order of TLS destruction.

2010-04-16 Carlos Garnacho <carlosg@gnome.org>

TrackerStore: Check client name before cancelling threads on client disconnection.

TrackerStore: Put client_id in TrackerStoreTask.

tracker-db-manager: wrap thread/iface hashtable access with a mutex.
Although unlikely, an interface for a thread could be created at the
same time another thread is being cancelled.

TrackerStore: Set watchdog timeout to control misbehaving queries.
If a query takes too long to be completed, it will be cancelled.

2010-04-16 Christian.Kirbach <Christian.Kirbach@googlemail.com>

Updated German translation

2010-04-16 Carlos Garnacho <carlosg@gnome.org>

TrackerStore: Cancel DB operations on client disconnection.

TrackerStore: Keep a list of running tasks.
These are removed from the queue as soon as they start processing, so keep them
elsewhere in order to have cancellation work.

TrackerStore: Fix harmless typo.
The variable should have the same place within the union.

tracker-data-manager: Add tracker_data_manager_interrupt_thread()
This is a thin layer on top of tracker_db_manager_interrupt_thread().

tracker-db-manager: Add tracker_db_manager_interrupt_thread().
This call will interrupt any SQL operation running on that thread.

TrackerDBInterfaceSqlite: Implement interrupt().

TrackerDBInterface: Add interrupt() method.
This should be callable from other threads.

2010-04-16 Aleksander Morgado <aleksander@lanedo.com>

Proper indentation

2010-04-16 Martyn Russell <martyn@lanedo.com>

Functional Tests: Added basic file operations to miner-fs and support for desktop environment

2010-04-16 Mikael Ottela <mikael.ottela@ixonos.com>

Added some full content queries for testing. Fixed a few problems.

Add videos to data generation.
Add videos to data generation. Fix some issues with images.

Small fixes to the data generators
Add large test set configuration max.cfg

Added some indices for query performance

2010-04-15 Aleksander Morgado <aleksander@lanedo.com>

Fix GB#615868: Improved OASIS extractor
* Fork & spawn asynchronously
* Buffered read, up to (3 * max_words * max_word_length) bytes max
* Stop reading when max words reached

2010-04-15 Jürg Billeter <j@bitron.ch>

libtracker-db: Use multi-thread mode in SQLite
Serialized mode is not necessary as we do not use the same database
connection in multiple threads.

tracker-store: Execute requests in thread pool
Currently limited to one extra thread.