torsten's .NET blog - RSS Bandit and the 100% CPU issue

Wednesday, March 07, 2007

RSS Bandit and the 100% CPU issue

Today I could track down an annoying issue: on some installations of the newer version of RSS Bandit (starting with the first betas of 1.5.0.x) it starts using 100% CPU time on a thread. As we started also to use lucene.NET with this new release I guessed it was a related issue, I was right. But as we run into multiple issues with lucene it was not obvious as a separate problem. So here it is:

We used a slightly modified version of lucene.NET to include the available language dependent analyzers and stopword filters. Before we released, I already fixed some obvious issues I got with e.g. french stemmer. Now we got more with the CJK (Japanese/Korean, bug report) and possibly Chinese analyzers. It looks like it get into a state it never returns. The attached debug callstack was very helpful to got the direction to search for! I found this: TextReader.Read(char[], int, int) was called and the return value checked against -1 only, not against 0 (zero). So I run over all analyzers to find all the places I have to change that code and here it is: the modified lucene.net.dll (zipped, 142K).

To all users that run into the problem: can you test the modification, please? Just download, unzip into the installation folder, restart Bandit. Please report here (or as comments to the bug reports mentioned above) if it help - so we can refresh the installer for the major public.

Technorati tags: RSS Bandit | .NET

Wednesday, March 07, 2007 12:59:08 PM (W. Europe Standard Time, UTC+01:00)

Comments [22] |

Wednesday, March 07, 2007 6:47:29 PM (W. Europe Standard Time, UTC+01:00)

I had noticed a delay when clicking on different feeds when I installed the beta & the distribution.

The new DLL seems to have fixed this.

Thx

Chris Bennett

Wednesday, March 07, 2007 8:04:18 PM (W. Europe Standard Time, UTC+01:00)

Hi,
I'm French user.
I've used the new dll and doesn't work. Rssbandit.exe uses always 48% CPU when is in the systray...
My CPU PIV 3.4Ghz with HT and 1GB RAM.

yakpas |_| ifrance com

yakpas

Wednesday, March 07, 2007 11:04:33 PM (W. Europe Standard Time, UTC+01:00)

I want to add that recently the same problem is arrived on 1.3.042

yakpas

Thursday, March 08, 2007 2:34:48 AM (W. Europe Standard Time, UTC+01:00)

I'm a Chinese User. The dll seems to fixed the problem with with Traditional Chinese, Simplified Chinese, Japanese and Korean.

The following RSS URL always contains multiple languages, they may be used for your test:

Sun Bloggers - http://blogs.sun.com/main/feed/entries/rss
MSDN Blogs - http://blogs.msdn.com/MainFeed.aspx?Type=AllBlogs

Thx.

Bennett Yip

Thursday, March 08, 2007 9:59:59 AM (W. Europe Standard Time, UTC+01:00)

yakpas: this must be another issue with 1.3.0.42, because lucene usage is introduced only with the 1.5.0.x versions.
Bennett: thanks for the links!

TorstenR

Thursday, March 08, 2007 10:47:09 AM (W. Europe Standard Time, UTC+01:00)

Hi TorstenR,
Yes it seems to be another problem.
I can reproduce it on two differents computers, another is PIV 2.6Ghz, 1.5GB Ram.

I can send you my opml file, if you want.

yakpas

Thursday, March 08, 2007 3:56:43 PM (W. Europe Standard Time, UTC+01:00)

Torsten,

Since I installed the new lucene DLL I am now getting the attached error - (not on the first day, but since the second day of usage) - note that I had the 100% problem, but it appeared to go away with the .10 release itself.

General Information

RSS Bandit 1.5.0.10
OS Version: Microsoft Windows NT 5.1.2600.0
OS-Culture: en-US
Framework Version: .NET CLR v1.1.4322
Thread-Culture: en-GB
UI-Culture: en-US
Additonal Info:
ExceptionManager.MachineName: <<deleted>>
ExceptionManager.TimeStamp: 08/03/2007 14:51:08
ExceptionManager.FullName: Microsoft.ApplicationBlocks.ExceptionManagement, Version=1.0.1521.25102, Culture=neutral, PublicKeyToken=null
ExceptionManager.AppDomainName: RSSBandit.exe
ExceptionManager.ThreadIdentity:
ExceptionManager.WindowsIdentity: <<deleted>>

Exception Information
RssBandit.BanditApplicationException: Unexpected InvalidOperationException on SaveApplicationState() ---> System.InvalidOperationException: Index is closed
at NewsComponents.Search.LuceneIndexModifier.AssureOpen()
at NewsComponents.Search.LuceneIndexModifier.Flush()
at NewsComponents.Search.LuceneSearch.PerformPendingIndexOperations()
at RssBandit.RssBanditApplication.SaveApplicationState()
--- End of inner exception stack trace ---
================= End Entry =================

Thursday, March 08, 2007 4:49:37 PM (W. Europe Standard Time, UTC+01:00)

yakpas (and unknown with the exception report): can you please have a look for similar problem reports at http://dev.rssbandit.org (Bugs) and attach the new information(s) or open a new issue, please? Thanks!

TorstenR

Wednesday, March 14, 2007 6:43:48 PM (W. Europe Standard Time, UTC+01:00)

Now it's working smoothly. I installed RSSBandit today for the first time and I thought that it was an excellent program before getting into this cpu trouble, then I found this feed and I immediatly followed the instructions and the Bandit now is simply great. Great aggregator, wonderful team! Thanks, you made my life easier ;)

mariani_andrea@despammed.com (Andreas)

Monday, March 26, 2007 8:55:07 PM (W. Europe Daylight Time, UTC+02:00)

Hi Torsten,

How I can send you my opml file ?
I can't use my favourite rss program.... I'm very sad... and my thread is without answer...

Yakpas :-)

yakpas

Tuesday, March 27, 2007 9:01:25 AM (W. Europe Daylight Time, UTC+02:00)

Yakpas: open a new issue or select the appropriate an attach the opml (zipped) at http://dev.rssbandit.org (sourceforge), please.

TorstenR

Wednesday, March 28, 2007 4:10:41 PM (W. Europe Daylight Time, UTC+02:00)

Ok done !
[ 1689841 ] 100% CPU usage, too more feeds ?

yakpas

Wednesday, April 11, 2007 4:37:53 PM (W. Europe Daylight Time, UTC+02:00)

I was noticing max CPU on every startup, and this new lucene seems to have corrected that. Thanks.

Dwayne Melancon

Thursday, April 12, 2007 11:26:42 AM (W. Europe Daylight Time, UTC+02:00)

Thanks for information end very interesting Website. Bye.

Otty

Thursday, April 12, 2007 2:03:01 PM (W. Europe Daylight Time, UTC+02:00)

Hello TorstenR,

Have you reproduced my problem ?
I've added the file that you've asked, but it is always not assigned.
[ 1689841 ] 100% CPU usage, too more feeds ?

Sorry, Bandit miss me. Now, I can't use it.

yakpas

Thursday, April 12, 2007 5:54:29 PM (W. Europe Daylight Time, UTC+02:00)

yakpas: sorry, but I was out of office (and home) over easter and had no time yet to look into the issue. But I will do so hopefully next week.

TorstenR

Friday, April 13, 2007 1:42:51 PM (W. Europe Daylight Time, UTC+02:00)

sorry, sorry....
you have time before you.... it will be my turn to be on vacation in 8 days ;-)

yakpas

Friday, April 20, 2007 4:59:55 PM (W. Europe Daylight Time, UTC+02:00)

I am a Brazilian user. Just replaced the required DLL today and the problem is gone. Thanks a lot.

Luis Soares

Saturday, May 19, 2007 5:55:39 AM (W. Europe Daylight Time, UTC+02:00)

TEST

anonymous

Friday, June 15, 2007 5:19:29 AM (W. Europe Daylight Time, UTC+02:00)

thanks!

结婚礼物

Tuesday, August 21, 2007 4:06:06 AM (W. Europe Daylight Time, UTC+02:00)

Traditional Chinese, it works great! Thank you.

ChrisTorng

Sunday, September 30, 2007 12:22:17 PM (W. Europe Daylight Time, UTC+02:00)

very good,thanks for your article

runescape

Comments are closed.