Excluding Posts from a category appearing in chronological page navigation.

I have read this post: http://forum.bytesforall.com/showthread.php?t=3500 and it comes close to what I am trying to do.

I have a blog category called "blog" -- http://www.blackpawphoto.com/category/blog/ -- I want posts from this category to show up only when folks go directly to that page.

I do not want post from the "blog" category to show up when browsing through posts from my tow other category "recent-work".

For example, on the following post's page: http://www.blackpawphoto.com/music-photos-audiometry/ -- You can see that the post named "Test Post" shows up in the navigation at the top/bottom of the page.

That post is from the "blog" category, and I would only like posts from the "blog" category to be visible when people go directly to the blog category page.

If anyone knows how to set this up, the help would be appreciated.