The Trendiction crawler constantly monitors all sources marked for retrieval. As soon as new data is discovered, the data is analyzed, saved locally and made available to the data streams in near real-time. New sources are automatically identified and, if relevant, added to the list of monitored sources.