TumblTwo - An Improved Fork of TumblOne, a Tumblr Downloader

Introduction

Note: New users should directly check out TumblThree.

Over the last week I reverse engineered TumblOne by Helena Carver. The project is under Public Domain and thus free from copyright. Since there was no source code available and I always wanted to see how easily one can decompile .NET assembly and wanted to add new features, I thought I would give it a try and reflect it. Bonus: I've never touched C# before and this way, I could learn a new language on top.

There are other people on the projects discussion page that suggested similar features and since the development seemed stalled, I thought about releasing the code and the binary with my changes, thus probably also under public domain.
I don't want to take over the original project, nor infringe any copyright or claim fully authorship. So, if the original author wants to continue her project, I'd be happy to help and see my changes committed. For the meantime, I thought of a fork for the changes and a new project name.

TumblTwo, a TumblOne Fork

TumblTwo is an image downloader (crawler) for the Bloghoster Tumblr.com based on TumblOne. After supplying a url, the application will search and download all types of images in a given resolution. It's possible to download only tagged images and download simultaneously from multiple blogs and enqueue others.

Screenshots:

Main UI, showing a list of blogs an top, the current queue status in the middle. On the right side are the control for managing the blogs and the crawl process:
TumblTwo Main UI

Program Usage

  • To use the application, simply copy the url of any tumblr.com blog you want to download the pictures from into the textbox at the top. Afterwards, click on 'Add Blog' on the right.
  • To start the crawl process, click on 'Crawl' on the right. The application will regularly check for (new) blogs in the queue and start processing them, until you stop the application by pressing 'Stop'. So, you can either add blogs to the queue via 'Add to Queue' first and then click 'Crawl', or you start the crawl process first and add blogs to the queue afterwards.
  • You can set up more than one parallel download in the 'Settings' on the right side. Also, it is possible to change the download location and the sizes of the pictures to download there.

Tags

  • You can also download only tagged images by adding tags in a comma separated list in the tag column of the blog list in the top. For example: great big car,bears would search for images that are tagged for either a great big car or bears or both.

New Features

New Features (over TumblOne):

  • multiple simultaneous picture downloads of a single blog, customizable in the settings. As an alternative, each picture is downloaded successively.
  • multiple simultaneous downloads of different blogs, customizable in the settings.
  • possible to download tumblr.com hosted videos.
  • it is possible to download images from blogs only for specific tags.
  • a clipboard monitor that detects http:// .tumblr.com urls in the clipboard (copy and paste) and automatically adds the blog to the bloglist.
  • a download queue for blogs.
  • a detection if the blog is still online or the owner has changed.
  • the blogview is now sortable and shows more information, e.g. date added, last time finished and the progress.
  • a settings panel (change download location, turn picture preview off/on, define number of simultaneous downloads, set the imagesize of downloaded pictures).
  • Somewhat overhauled user interface which is resizable, faster and saves and restores its settings.
  • Source code at github (Written in C# and WinForms).

Changelog

2016-06-10:

  • Support for tumblr.com hosted videos. Check the settings window to enable video download (default: off).
  • This is probably going to be the last release.

2016-05-24:

  • New icons as it has been requested by the author of TumblOne.
  • I am not the author nor owner of the website tumblone.com and not responsible for the content of this particular site.

2016-04-09:

  • Support for urls starting with https: instead of http:
  • The image preview now applies its visibility settings upon startup.

2016-04-04: Code Refactoring

  • Started my complete code rewrite in C# using WPF and MVVM pattern. Most things are already done and set up but not debugged yet. Some converters for the UI are still missing. New features will be:
    1. Better and modular code!
    2. Internationalization support
    3. A blog rating system
    4. Save and restore, clear queuelist
    5. Movable items in queuelist
    6. Taskbar buttons and progress indicator
  • Maybe it's possible to add support for new websites now, and it's certainly possible to add video support for tumblr.com hosted videos without a big hassle. CLI support and at some point i'm planing a mono gtk# UI for linux support. A screenshot showing the current state:
    TumblThree - Core rewrite featuring C# and WPF with MVVM pattern.

2016-03-11:

  • Since we have to pre-crawl all image urls for the parallel image downloading, we now use its count for better progress indication instead of the total blog post count, which might contain double posts of the same image (seems to happen a lot), text, videos, etc..

2016-02-28:

  • Version bump: Version 1.0.7.
  • Some images were reloaded even if they were already downloaded since we have saved the full url and checked for duplicates using it. If the file however was hosted on a different mirror, the application would redownload the same file and increase the counter for downloaded images even if it was already downloaded.
  • Finally, the program should work quite nice for everyone now I hope.
  • Half finished mono release for Linux. It just runs and downloads, .. [GPG sig]
  • Next Steps:
    1. I am going to upload a "mono" version for linux in a few hours/days without the clipboard monitor as it relays on windows 32 apis which seems to break the application. All the other stuff seems to work, after all the path handling in the code as been sanitized, thanks to \ and / in Windows and Linux, respectively
    2. Get rid of the progress indicators in the button as they are too troublesome for multiple blog downloads and provide similar or better information in the blog list at the top.

2016-02-27:

  • Set a maximum degree of parallel downloads to prevent connection timeouts and connection closures from tumblr.com which appeared on my site after around 6,000-10,000 images. The crawl seemed stalled after a while, then finished before downloading all images. I've set the value to 50 20 and they are divided by the number of parallel blog downloads in the settings. When you crawl multiple blogs at once, you might have to adjust this value in the settings as it depends on your bandwidth. Thanks for the email regarding this issue!

2016-02-26:

  • Further integrated the versions. The parallel crawl is now the default and integrated in the main TumblTwo.exe. You can switch to the old, serial download method in the Settings.

2016-02-25: stable releases

  • Integrated the beta (tags) version into the main version, so no more "beta" right now. You add tags in the main blog list as comma-separated list e.g.: great big car, bears would search for images that are tagged for either a great big car or bears or both. Tags are saved and get reloaded if the blog was crawled for those once. Just clean the tags column to search for all images again.
  • Clicking the picture preview in the bottom right corner opens a fullscreen preview. Upon clicking it, the normal view returns.

2016-02-24: stable releases

  • I did a two day code cleanup to enhance and someday remove the wonky User Interface. The new versions aren't compatible with the previous ones yet.
  • the blog data is now mostly updated automatically without me messing around doing so manually. Thus this should greatly improve accuracy, amount of errors and remove lag
  • the blogview now saves the column order, width and so forth. The Columns can be reordered.
  • the blogview progress is now under layered with a progressbar.
  • Probably more i already forgot. I am going merge the tags (beta)-version into this one and someday will come up with a new interface after reorganizing the code further. I just thought this might be a good intermediate version/step (for newcomers) as the UI should be more stable now, and the old versions are still here for download (since the data files are not compatible yet).

2016-02-22: all releases

2016-02-19: all releases

  • It's now possible to download photosets.
  • Added a detection if the blog is still alive and/or if its the same blog. Therefore we use the HTML Title and the blog description. I wasn't sure if the title would be enough, since many blog titles are simply equal to the url, which might not change if the owner the blog changes. Thus, I'm also taking the description into account, but I'm not sure if they frequently change. So, I'm happy about any input in the comments/per mail about this if we're generating too many false positives.
  • A more parallelized version for single/few blog downloads can be found here: Windows Application (.exe) (~248 kb) [GPG sig] - Windows Application (.exe) (~248 kb) - Beta [GPG sig]. I haven't yet much time to test it, but maybe it's worth a try if you don't download multiple blogs at once. The picture preview might lag/show nothing and the "stop/pause" won't come at once since we "batch" download up to 50 images, but otherwise it should work.

2015-11-23: all releases

  • Allows Column Sorting
  • Added a process percentage column in the Blogview (no fancy progressbars yet).
  • "Delete Blog" now deletes only the index file and removes the blog from the view, but does not delete any downloaded images.

2015-09-08: all releases

  • It's now possible to import TumblOne-Blogs by simply addind/moving the proper .tumblr files from the Index folder of TumblOne (which is also located inside the \Blogs\ folder which holds your downloaded pictures right next to where the TumblOne.exe is located) into the Index folder of your download location set in the 'Settings' window in TumblTwo. The blogs will be added but will be showing a "not yet crawled!". Thats okay, because we use a different counting mechanism. After starting the first crawl, the proper index will be adjusted.
  • For an update on video / larger image support, see here

2015-09-01: stable and beta release

  • Removing a blog is now always possible and does not result in a reload of the whole library (not sure, why this was implemented in the first way.)
  • Some fixes for the progressbar.
  • Some minor UI code changes and cleanup.

2015-08-28: stable and beta release

  • Added a Clipboard Monitor. Enabled by default, can be turned off in the mainwindow on the right side panel. Once turned on, if you ctrl-c or copy any text which contains one or more Tumblr blog urls, the blogs will be automatically added if they don't exist.
  • Disabled useless startup splashscreen.

2015-08-27:

  • Beta release (Not really well tested yet). Crawl only specifically tagged images. Crawl only specifically tagged images by specifying the tags in the Queue Window in a comma separated way. I.e: Aston Martin,ferrari,Porsche. Consequently, the Blog is crawled for any image that matches the given tags. To do so: add the desired blog to the queue, without starting the crawl process. Now click in the cell next to the blog with the column header Tags for crawling. Enter your tags in a comma separated way, finish with enter. Start the crawl. If you don't bother about tags, simply don't add anything to crawl the whole blog.

2015-08-26:

  • Fixed threading wonkiness. Sometimes, the queue still got depleted from idling tasks after pressing 'stop'.
  • Adjust the number of simultaneous downloads without a necessary restart of the application, if the number of threads is not smaller than it was before and if the crawl process is not currently running.
  • Make sure the download location is always correct (trailing backslash) to fix the "The current blog cannot be saved to disk"-bug.
  • Now saving the windowsize and its position.

2015-08-25:

  • Large Speedup for startup times and resuming of blogs since we now catalogize all downloaded filenames together with their URLs in a small single index file, instead of checking for all single downloaded image files in the download folder at startup and which is now also used for duplication check. This should improve speed drastically. Also, its now possible to safely remove images out of the \Blogs\"MyDownloadedTumblrBlogFolder"\ without rendering in download them again, as long as you keep the .tumblr (index) file in the Index folder. This opens the way to a backup function.
  • Specifying the number of Posts in each blogs. Might be equivalent to number of pictures, if the blog only contains pictures.

2015-06-04:

  • Added Multiselection in the Blog and Queue View.
    To add multiple blogs at once to the queue, select the blogs with the ctrl-key or shift-key pressed, then hit "Add to Queue". Same for removing, just in the "Queue"-view and hit "Remove Queue" (Thanks to Torn for suggesting this!).

2015-04-08:

  • multiple simultaneous downloads
  • a download queue
  • a settings panel (change download location, turn picture preview off/on, define number of simultaneous downloads, set imagesize of downloaded pictures)
  • the tumblrlist now features columns for 'Date added' and if and when the blog was completely crawled
  • saves and restores settings
  • resizable UI

Possible next Features (ToDo-List):

  • prevent downloading "Image has been removed" / same images
  • add a 'expiration date' to crawl only newer images in specific blog -> Partly done: You can simple recrawl all blogs, as long as you keep the Index (.tumblr) files, only newer images will be downloaded, since all images (the download url and the filename) are catalogized in the index file. No redownload occurs.
  • option to automatically remove blogs when crawling is complete.
  • batch input of tumblr blog urls from text file -> We check the Clipboard for URLs now. Simply ctrl-c your text file.
  • import blog index files from TumblOne.
  • 'backup function' for blog indexes -> Check your Downloadlocation\Index\ folder and save the appropriate .tumblr file for your specific blog.
  • Download only specifically tagged files.
  • proxy setting
  • allow to download videos files.
  • Download photosets
  • Download inline images from other types than pictures posts (for example Question and Answers)

Bugs:

I'm completely new to C# and (safe)-threading programming and if anyone wants to help, feel free to commit. So, beware of the code ;). I'll add source code annotations over the next few days and the first git commit is the pure reverse engineered TumblOne code without any modifications from my side.

Download

Comments

zab
Tue, 08/09/2015 - 17:28

Please also try the new version and reset your download location as the download location was screwed up and files could probably not be proper saved, maybe that fixes the problem. If not, please tell me the blog so that i can look into your issue!

Thanks!

Doug (not verified)
Thu, 10/09/2015 - 13:39

I been using the new version and it works. Thank you for time and hard work !!!

James (not verified)
Thu, 24/09/2015 - 18:18

Hi, Thank you so much for your contribution to this but i have a slight problem. So there's a post that has multiple gifs in it eg. http://tipannies.tumblr.com/post/129740250527/tiffany-being-a-cutie-pie-...

The stable release version crawls all 8 of the gifs but when i try to crawl it on the beta version ( so i can crawl only specific tags) it will only crawl the first gif and skip the rests this also happens with photos please help! :)

anonymous (not verified)
Tue, 29/09/2015 - 05:18

Hello! First off I want to thank you for your efforts and dedication in improving such a great program. I recently attempted to use your updated Windows version: Windows Application (.exe) (~248 kb) [GPG sig] as well as the Windows Application (.exe) - previous working release (~246 kb) [GPG sig]. However for some reason when I go to use the Crawl function there is no activity and the program stalls to download any images from the given URL. It seems to be stuck and it never downloads. Was wondering if you had any advice or if it works on your end? Thank you!

zab
Tue, 29/09/2015 - 16:51

Did you add your blog to the download queue as well. It's not enough anymore to simply press 'crawl', you also have to add your blog to the download queue. Is the whole UI stalled, i.e. there is the spinning circle/hourglass in windows?

Otherwise, maybe i can help if you tell me the URL of that specific tumblr blog.

thatanon (not verified)
Sun, 18/10/2015 - 13:54

Thanks for developing this program! It works great, and I love how you can keep a stored list of blogs. I've only found one other program that does this, and you have to pay to keep more than 5.

I was wondering, might you add the option to download inline images as well? An example would be like this: http://turtlequeen.tumblr.com/post/125042995426/

Thanks again for this program - I was so happy when I found it (that is, I was when I figured out how to use it; it took me an embarrassingly long time to figure out you had to queue blogs before crawling them /headdesk/).

zab
Tue, 20/10/2015 - 20:18

hiya!

Thanks for your reply and for giving the program a try..

I've just checked the source and i think it's doable and not too time consuming. I'm just literally all day at work and only and immediately sleep at home.
I think I'll have time to look into this this weekend!

Skapes (not verified)
Sun, 15/11/2015 - 15:44

Amazing work !! Thanks for all !

However, I have some suggestions if you allow me:
- Have the ability to display a full-screen preview (or larger)
- Add preference "Skip GIF-Files" in the options, in order to implement that choice by default. (I don't want to download GIFs at all)

Anyway, thank you again for this great work!

Skapes (not verified)
Tue, 17/11/2015 - 18:02

Great, you're about to create the perfect crawler ^^

I used the first version for a long time, the import into your fork was smooth and easy, really appreciated !!

A little feedback, just to complete my firsts suggestions, after a few uses:
- Add "Check Clipboard" in the settings (for default behavior, same as GIFs request)
- I suggest to check if blog is active/exist (because crawl process freezes when scanning olds inactives blogs, that I imported from T1) and why not display it in a column
- surprised that the columns are not sortable ... it is not annoying but this option would be welcome ;)

Thank you again for sharing your work, you are our savior !

Paul (not verified)
Sat, 21/11/2015 - 16:55

Works very slowly for me - 1mb of pictures for 10 minutes. What' s wrong?

Jerome (not verified)
Sun, 20/03/2016 - 03:28

Perhaps upgrading from dialup....dsl?

It cant be this amazing program, you're the first to report issues on speed.

CJayPL (not verified)
Thu, 26/11/2015 - 11:21

Hi again. So far great job. I'm very happy of sorting, it solves a lot of issues. Putting all new features into settings was brilliant too. Something went wrong with the individual progress bars, changing it into numbers saved us from too much annoyment - great thinking (and personally I find the numbers a better option). But the problem remains, lot of blogs can't be checked on startup, my guess is that it has something to do with deleting posts - some of my bogs have the progress value over 100 (and I assume its %) so if post are deleted and I have that images saved on HD then it will show over 100 - no bug here.

Suggestion - it occured to me that the middle and bottom panels (Queue and Download) are not neccessary, you could add a indicator column in Blogs panel and it could show the current status of a blog
- green circle - blog is being crawled
- yellow triangle - blog is in queue
- red square - blog does not exists (url not found)

CJayPL (not verified)
Thu, 26/11/2015 - 16:35

I just realized my mistake regarding the progress bars (numbers in this case) and how you count the progress, and have to say it's not the best way - you're getting values over 100% which are confusing when displayed on larger number of blogs. I realize also that it may be impossible to count number of photos on specific blog, but it can be worked around. You can get the number of posts from blog when blog is added to library and crawled so use only that data - divide "number of posts LAST CHECKED" by "number of posts NOW" (100*LC/N) and it should give you a more accurate progress. Of course this method will give a false over 100% when posts will be deleted. Still it's better than actual count ;)

zab
Thu, 26/11/2015 - 19:11

Yupp, true. Actually, i thought i was doing it the way you described it, but apparently the number of blog entries index gets never updated.. Thats easy to fix though.

I'm rewriting the download code right now and also playing around with asynchronous downloads (i.e. start many downloads and don't wait to check if they finish before downloading the next file) which should vastly improve the speed if you only download from one blog..

I'll upload a new version in the next days and fix your point(s)..

Thanks!

Lucently (not verified)
Sat, 28/11/2015 - 05:07

Hello!
Thank you for this useful application and I have some problems.
There are over 200 bolgs I need to crawl by this application,but when I set the download location(most of these blogs have been crawled over by Tumblone and I just want to use Tmubltwo to update them) the program will crash down because of the huge amount.
How can solve this problem?
Please help me!

Bonny (not verified)
Thu, 24/12/2015 - 07:51

if the Imagesize exceeds 1280 and becomes an arbitrary number, the crawler will fail to download any images and instead only detect posts.
I assumed a blank would mean all pictures and have been pulling my hair out.

Jamie (not verified)
Sun, 27/12/2015 - 09:15

This is a much appreciated app, thanks for all this hard work. I was using tumblone for quite awhile and I appreciated that amazing program too.

Googlysmooth (not verified)
Wed, 27/01/2016 - 22:34

I have modified the default directory settings, and now, when I add a blog, it tells me it can't save it.
when I try to add to queu, it says part of path is missing, I also can not delete the blog once added.

how can I reset the settings to its default, so I can delete/add blogs without issues?

zab
Thu, 28/01/2016 - 11:56

hmm.
I wonder why that would happen though if you've entered a valid path, but unfortunately there is no reset function implemented. However, you can navigate to

C:\Users\"YourUserName"\AppData\Local\jzab.de

and simply remove everything there. That will set everything to defaults upon the next boot. Make sure the application is closed when you delete the files.

John (not verified)
Thu, 11/02/2016 - 03:17

I'm running into issues trying to use TumblRipper for this purpose, so I would like to change over to TumblTwo completely. Unfortunately, for some blogs, I get several times more photos from using TumblRipper than when using TumblTwo. I'll happily pay for this program if that feature becomes available. Video support would be appreciated too.

zab
Sun, 14/02/2016 - 17:39

hiya!

Actually, I was writing on a complete rewrite of the code with new interface (WPF) and no more spaghetti code,.. but i'm kinda short of time right now.. Then maybe one could think about video if everything is more modular..

Could you give me an example for a blog where you get more pictures using TumblRipper? Then i can look into that..

Edit: ah, now i see you mean photosets. I'll look into that again and tell you if i am going to implement that (soon(TM)), ...

Edit2: Shouldn't be too difficult, i'll add that sometime next week.

TSandayu (not verified)
Mon, 22/02/2016 - 16:21

Just tried the latest updates and a minor problem, after crawling a blog. It updates the date added field instead of the Last Crawled field. After restarting it shows the correct date last crawled, so not a major problem.

zab
Mon, 22/02/2016 - 16:43

Ok, thanks for noticing. Thats why I was going the change the whole UI stuff soon because it's way too messy , ..

Sat, 27/02/2016 - 14:56

I am using TumblTwo in an older version and hopped on to a beta to get more features.
Now TumblTwo Stable states as 1.0.6 which is the same version as my beta here.

BUT

TumblTwo Stable does not read the blog list correctly.
The only thing I see is a table without anything and the status of these is "offline".

Whereas TumblTwo Old (as of today) reads the blog list correctly.

Windows 10 x64

zab
Sat, 27/02/2016 - 15:34

I had to change the data structure from TumblOne to decouple the UI more from the data in the feature. I've written that somewhere in the changelog.

I'll add an import function as the next step as the program itself seems finally quite usable now..

John (not verified)
Sun, 28/02/2016 - 17:41

I pretty consistently get .net errors. Is there a recommended version of ,net?

The application still seems to work even after the error pops up. I have not migrated to your newest builds, im like a week behind, waiting for that index file import. Thanks!

See the end of this message for details on invoking
just-in-time (JIT) debugging instead of this dialog box.

************** Exception Text **************
System.ArgumentOutOfRangeException: StartIndex cannot be less than zero.
Parameter name: startIndex
at System.String.Remove(Int32 startIndex, Int32 count)
at TumblOne.Form1.<>c__DisplayClass66.b__44()
at System.Windows.Forms.Control.InvokeMarshaledCallbackHelper(Object obj)
at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state)
at System.Windows.Forms.Control.InvokeMarshaledCallback(ThreadMethodEntry tme)
at System.Windows.Forms.Control.InvokeMarshaledCallbacks()

************** Loaded Assemblies **************
mscorlib
Assembly Version: 4.0.0.0
Win32 Version: 4.6.1063.1 built by: NETFXREL3STAGE
CodeBase: file:///C:/Windows/Microsoft.NET/Framework64/v4.0.30319/mscorlib.dll
----------------------------------------
TumblTwo
Assembly Version: 0.0.0.0
Win32 Version: 1.0.6.0
CodeBase: file:///D:/Imgur%20-%20DL/TumblTwo/TumblTwo_beta.exe
----------------------------------------
System.Windows.Forms
Assembly Version: 4.0.0.0
Win32 Version: 4.6.1038.0 built by: NETFXREL2
CodeBase: file:///C:/WINDOWS/Microsoft.Net/assembly/GAC_MSIL/System.Windows.Forms/v4.0_4.0.0.0__b77a5c561934e089/System.Windows.Forms.dll
----------------------------------------
System
Assembly Version: 4.0.0.0
Win32 Version: 4.6.1038.0 built by: NETFXREL2
CodeBase: file:///C:/WINDOWS/Microsoft.Net/assembly/GAC_MSIL/System/v4.0_4.0.0.0__b77a5c561934e089/System.dll
----------------------------------------
System.Drawing
Assembly Version: 4.0.0.0
Win32 Version: 4.6.1068.2 built by: NETFXREL3STAGE
CodeBase: file:///C:/WINDOWS/Microsoft.Net/assembly/GAC_MSIL/System.Drawing/v4.0_4.0.0.0__b03f5f7f11d50a3a/System.Drawing.dll
----------------------------------------
System.Configuration
Assembly Version: 4.0.0.0
Win32 Version: 4.6.1038.0 built by: NETFXREL2
CodeBase: file:///C:/WINDOWS/Microsoft.Net/assembly/GAC_MSIL/System.Configuration/v4.0_4.0.0.0__b03f5f7f11d50a3a/System.Configuration.dll
----------------------------------------
System.Core
Assembly Version: 4.0.0.0
Win32 Version: 4.6.1038.0 built by: NETFXREL2
CodeBase: file:///C:/WINDOWS/Microsoft.Net/assembly/GAC_MSIL/System.Core/v4.0_4.0.0.0__b77a5c561934e089/System.Core.dll
----------------------------------------
System.Xml
Assembly Version: 4.0.0.0
Win32 Version: 4.6.1064.2 built by: NETFXREL3STAGE
CodeBase: file:///C:/WINDOWS/Microsoft.Net/assembly/GAC_MSIL/System.Xml/v4.0_4.0.0.0__b77a5c561934e089/System.Xml.dll
----------------------------------------
System.Xml.Linq
Assembly Version: 4.0.0.0
Win32 Version: 4.6.1038.0 built by: NETFXREL2
CodeBase: file:///C:/WINDOWS/Microsoft.Net/assembly/GAC_MSIL/System.Xml.Linq/v4.0_4.0.0.0__b77a5c561934e089/System.Xml.Linq.dll
----------------------------------------

************** JIT Debugging **************
To enable just-in-time (JIT) debugging, the .config file for this
application or computer (machine.config) must have the
jitDebugging value set in the system.windows.forms section.
The application must also be compiled with debugging
enabled.

For example:

When JIT debugging is enabled, any unhandled exception
will be sent to the JIT debugger registered on the computer
rather than be handled by this dialog box.

zab
Sun, 28/02/2016 - 19:17

That's coming from the column save algorithm if you had a previous version with less columns than the current build. I forget to add a function to wipe the settings clean.

If you remove the settings folder in C:\Users\USERNAME\AppData\Local\jzab.de\ the application should start again and work properly. I'm not thinking of having a need to add any more new columns right now.

anonymous (not verified)
Tue, 01/03/2016 - 15:06

Hello!

Glad to see that TumblTwo is still rapidly developing. Tag support is killer feature, it save lot of time!
Is it possible to implement parsing and downloading images from Q&A posts in future versions?

Romance Thief (not verified)
Mon, 07/03/2016 - 03:04

A few things. Is there anyway to use a scheduled timer or download limit with this? For example; stop process after x amount of images have been downloaded? Or even after x amount of time has passed?

Also it would be nice to be able to export the image data like the URL and time of download into a file of some sort.

Romance Thief (not verified)
Fri, 11/03/2016 - 01:45

I'm also having a problem with the program forgetting added blogs each time it's restarted.

(Also hotkeys would be a nice feature)

zab
Fri, 11/03/2016 - 19:03

Any errors? Only specific blogs? Could you name some or send me the .tumblr file in the index folder? Or does it lose all blog entries.

I cannot think of any reason why this should happen.

Alex (not verified)
Mon, 14/03/2016 - 08:22

Hi!, Did you remove the options for tags (which is usually in beta) because I can't seem to find it and what does parallel downloads and blogs mean?

Thank you for the time and effort you put into this!!

zab
Mon, 14/03/2016 - 08:30

Hi..

No, you have to add them now in the upper list of blogs. Per default, the column is right next to the Date Added and Status columns. Just make sure you've add them before the program searches for image urls.

Nick (not verified)
Tue, 15/03/2016 - 09:57

The build from 2016-03-11 is working great so far. Just grabbed over 72000 images in 40 minutes. Fast and accurate. I've had problems with previous versions of TumblTwo (and other similar apps) giving slightly different results for every crawl session. I repeated the download from scratch and got the exact same file set, awesome.

Couple things I think would be easy (hopefully) to implement, that would be useful for sorting images to match the existing blog sequence.

1. Add a checkbox in Settings to set the image file's creation date attribute to the server's file timestamp.
2. Add a checkbox in Settings to set the image file's modified date attribute to the Tumblr post's timestamp.

I tested the first one by parsing out the urls from the *.tumblr file and feeding it into FDM (FreeDownloadManager). By opening the images in File Explorer, setting view to Extra Large Icons, and sort by Date Modified-Descending, you get a view very similar to the Tumblr's archive view. Having a posting date associated could also be useful for tracking down the original post to get additional information about the image.

Anyhow, great work on this, have a drink on me, cheers!

Zak (not verified)
Wed, 16/03/2016 - 03:24

I just download the software and try to download one Tumblr to make sure it was working but it says crawling blogs but no status and looks like it doing nothing.

zab
Wed, 16/03/2016 - 06:02

Which blog? Usually it works here. Must either be a particular blog, or maybe your save location is wrongly setup, that's all i can think of right now. Did you change it? What's written in there? Also make sure you have permissions to write there..

Did you try a different blog? Which OS are you running?

zab
Wed, 16/03/2016 - 11:12

Ah, now I got it.

You have to watch in the bloglist at the top on the most right under Current Progress, there is the progress per blog listed. It's easier and more accurate for multiple parallel blog downloads than the progress at the bottom.

Thanh Do (not verified)
Wed, 16/03/2016 - 11:13

Hello, I'm having trouble viewing my tumbltwo beta files as I move on to the recent 2016-03-11 tumbltwo. It loads but it doesn't show my files, it just says offline and when I try to crawl nothing happens

Any ideas??

Grey (not verified)
Sat, 19/03/2016 - 19:20

Is it possible to download only a certain tagged within a specific blog. Like instead of wanting to download all of (funnypictures.tumblr.com) I want to download just the pictures of dogs from that blog (funnypictures.tumblr.com/tagged/dogs)

Grey (not verified)
Sat, 19/03/2016 - 19:27

Sorry, I scrolled down and found out how in the instruction. I read it wrong and thought the tag search was referring to something else.

Best downloader out there, thank you

Jerome (not verified)
Sun, 20/03/2016 - 03:13

Hi there, its me again.
I see you've been making tons of progress, very nice & good job buddy.

So I've just downloaded the newer versions, both 1.0.7 & the beta 1.0.6

1.0.7 is really and I do mean REALLY fast.
For a test run, I found a random blog, downloaded 40k images in 10 minutes flat (using half my bandwidth).
Then I tried to import a few blogs from the older tumbltwo version I had, and it wasn't successful.
But whenever you get around to adding that ability, it will make it even better. Although I cant import old blogs (yet), Im very happy with what you have done so far.

The beta 1.0.6 version is a nice upgrade version from the previous ones, because I can now at least crawl multiple blogs together instead of running multiple instances in multiple directories. Its nice to have everything in one folder now. Not to mention it can still allow you to import from previous versions. I plan to use it to update my crawled blogs, then when you add importing to 1.0.7/8 or which ever version you do, I'll then import over to it.

My WishList:
1) Ability to select all. I prefer to be able to right click and drag to mark/tag all that I want to recrawl for precision. Or a "Select All" button (then I could just deselect manually what I dont want selected)
It was painfully slow adding all my blogs to queue to recrawl & update because I had to click each one by one.

2) Import old blogs to the next current version.

Oh, what does "Inf" means? I see that for blogs that are both online & offline
Lastly, to get a better/more accurate progress reading, I think that once the program calculates how many items are there, it should then subtract the number of images (or gif's & images if gif is enabled).
Total 10,000 items, 7500 images...so math should be 7500 out of 7500 to be downloaded.

Will be back once I remember the rest of my wish list.

Jerome (not verified)
Sun, 20/03/2016 - 18:30

3) Ability to stop a specific blogs from being downloaded from the queue.
Currently, I'd have to stop my whole queue just to stop 1 or 2 blogs from being downloaded. Then I'd have to go back and re-select all blogs I want re-crawled all over again.

Jerome (not verified)
Mon, 21/03/2016 - 01:53

Just downloaded new version.
I tried to crawl a single blog, and it appears to be stuck at "calculating new image urls"....been saying that for about 15 minutes now. I'll let it run the rest of the night to see if starts to crawl.

Another thing, when it calculates the number of items, it appears to now be much slower than the previous version.

Thanks for granting WishList #2...now its just a matter of optimizing it again :)

Jerome (not verified)
Mon, 21/03/2016 - 20:12

The version from "2016-03-20" never crawled anything and I left it on all night.

So I just downloaded the updated version from "2016-03-21". Tried to crawl 1 blog and its been stuck on Calculating new Image URLs for a couple of hours, so its not working either.

I think you misunderstood what I was trying to explain in my previous post. I'll try to explain in better details.

After you add a blog to queue, then press Crawl, the Evaluation of tumblr posts urls out of "x" posts is much slower than the initial release of 1.0.7. In the initial release of 1.0.7, the evaluations were pretty fast (even when multiple evaluations are being executed for multiple blogs) If you could restore it back to the initial 1.0.7 release, that would be nice....but its not a big deal or top priority because it still gets the job done.

Once its done with evaluating number of posts, it then stalls at "calculating number of image urls".
While its calculating the number of image urls, it does NOT consume a lot of cpu power or time. Im guessing that it isn't doing anything at all, because I dont notice a spike increase on my cpu. Im running 8 cores so even if it were to require more cpu power to do a mirror check, i wouldn't personally mind because it will be fairly quick on my I7 Cpu. While I do NOT notice a spike or increased activity, its safe to say that the mirror check isn't working because of 2 reason:

a) toggling on or off mirror check has no effect whatsoever. even while the default setting is "OFF", it still tries to calculate number of image urls.
b) even on small blogs that only has 20 images, calculating new images still doesn't work even after running for hours. so its not related to big blogs, it appears that it not actually calculating anything, or perhaps the math is wrong and its an endless loop of calculation

Hope that explained it crystal clear.

Pages