SysNucleus : Blog

USBTrace version 2.8 Released !

sysnucleus — Wed, 03 Apr 2013 04:20:08 +0000

We’ve just released the latest update of USBTrace, the USB analyzer software for Windows. The changes in this update are :-

Added option to timestamp captured requests in ‘system’ time (HH:MM:SS:milliSeconds)
Added decoding of bConfigurationValue in Configuration Descriptor
Captured Data Export (HTML, CSV, XML) made faster
Added headers for HTML and XML export files
Updated USB device list for VID/PID decoding
Layout of Search/Filter/Trigger windows changed
More support for Windows 8 and USB 3.0 (SuperSpeed USB)
Minor bug fixes

You may download the 15 days free trial version of USBTrace USB Analyzer from http://www.sysnucleus.com/usbtrace_download.html.

To all customers of UniBlue’s software who have incorrectly installed our drivers

sysnucleus — Mon, 18 Feb 2013 04:32:44 +0000

This post is for all customers of UniBlue’s driver update software who have incorrectly installed our software’s drivers.

First off, kindly be informed that the drivers which are incorrectly installed in your systems (which has rendered most of your USB devices unusable) is a software component which is exclusively used by our software – USBDeviceShare (http://www.sysnucleus.com/usbshare/).

We own this driver and have NOT authorised any third party company (including UniBlue) to redistribute our drivers. Our drivers are meant to be used along with and only with our software. They are meant to be installed only along with the installation of our software.The problem which you are currently facing is due to UniBlue’s software. We have contacted them regarding this, and have also requested them to remove our drivers from their updates. We are yet to receive a reply from them.

Update (Feb 20, 2013) : Uniblue Technical Support has informed us that they will investigate this issue and take immediate action

Since our drivers are involved and since many of UniBlue’s customers are contacting us regarding a solution to this problem, we are listing below the steps to be followed to remove our drivers from your system. For more assistance we request you to contact UniBlue itself. We have our own customers to support and it is beyond us to attend to each of you, mainly because the problem was initiated by UniBlue.

The solution is to remove the USBDeviceShare’s driver completely from your system. For this you may need to plug in a non-USB mouse/keyboard to your system, if the current ones are not working. Please follow the steps below :

1. Go to c:\windows\inf directory

2. Search for all files (*.*) containing the text ‘udsstub.sys’

3. Delete all files displayed in the search result

4. Delete the file ‘udsstub.sys’ from c:\windows\system32\drivers folder

5. Open RegEdit (Run ‘regedit’) – in administrator mode

6. Delete the key HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\services\udsstub (including subkeys)

7. Restart your system and see if the problem is solved.

You may also try to update the device driver directly :-

1. Open device manager

2. Locate the node corresponding to non working devices

3. Right click and update driver

4. Select ‘Browse for driver on my computer’ and later ‘Let me pick from a list of drivers on my computer’ options

5. Select the correct driver from the list displayed

We hope that the above instructions will help you remove our drivers, but if it does not please contact UniBlue support. If they do not remove our drivers there is a chance that the same issue can happen again in the future.

Web Scraping from Command Line

sysnucleus — Thu, 17 Jan 2013 06:31:53 +0000

WebHarvy supports command line arguments so that you can run the software directly from the command line. This allows you to run WebHarvy from script or batch files, or to invoke it via code from your own applications.

To know more, read : Running WebHarvy Web Scraper from Command Line

Schedule scraping tasks

sysnucleus — Thu, 17 Jan 2013 06:22:02 +0000

WebHarvy comes with an in-built scheduler using which you may schedule your scraping tasks. The scheduler window can be opened from the Mine menu.

WebHarvy Scheduler

The scheduler enables you to run scraping tasks periodically – daily, weekly or monthly.

Know More about WebHarvy Scheduler

Download and Try the free 15 days evaluation version of WebHarvy Web Data Extraction Software.

WebHarvy v2.0 Released !

sysnucleus — Fri, 14 Dec 2012 09:21:05 +0000

The new features in the 2.0 update are :

Built-in scheduler for running scraping tasks – (know more)
Command Line Options – (know more)
MySQL Support for exporting scraped data – (know more)
Option to scrape sub text of selected text – (know more)
Updated proxy settings – (know more)
- Supports proxies which require authentication
- Supports importing proxies from CSV/Text files
Option to resume mining from where it stopped/aborted
Option to auto-save captured data on regular intervals – (know more)
Option to automatically inject pauses while mining (prevents IP blocking) – (know more)
Major improvements in mining
Minor changes
- Number of pages & records mined are always displayed in Miner window’s status strip
- Fixed bug related to capturing images where image text is empty
- Updated capturing email addresses
- Record numbers displayed inside captured data grid view in Miner window
- Option to cancel preview generation for large index page data

You may download the latest version of WebHarvy Web Scraper from http://www.webharvy.com/download.html.

Sniff HTTP from iPhone, iPad

sysnucleus — Thu, 23 Aug 2012 11:08:50 +0000

HTTP traffic exchanged between browsers and web servers can be sniffed and analyzed using the HTTP Trace app for iOS.

Click to view slideshow.

The app captures and decodes the following HTTP data :

HTTP Headers and Cookies
URLs and Methods (GET, POST etc)
Parameters sent in Query String and Post Data
HTTP request and response body (content)

App website :- http://www.sysnucleus.com/httptrace/index.html

Capture / Sniff / Analyze HTTP from iOS

sysnucleus — Thu, 23 Aug 2012 10:56:09 +0000

Presenting our brand new app for iOS devices : HTTP Trace. HTTP Trace is an HTTP Sniffer (Analyzer) for iOS devices. HTTP Trace is a universal iOS app which runs on iPhone, iPod Touch and iPad.

iTunes Link : http://itunes.apple.com/us/app/http-trace/id517641852?mt=8
App website : http://www.sysnucleus.com/httptrace/index.html
Price : $3.99

Web developers and administrators who tinker with stuff going around in the background of browsers will find this app very useful. This app lets them see the HTTP traffic exchanged between browsers and remote web servers as users interact with websites.

How to remotely access USB devices when USB server is behind a router or firewall ?

sysnucleus — Tue, 10 Jul 2012 10:28:28 +0000

The callback connection feature of USBDeviceShare allows you to establish connection between the server and the client even when the server cannot accept incoming connections. The server will not be able to accept incoming connections if it does not have a directly accessible IP address (example: when server is behind a router or a firewall).

In callback connection mode, the client waits for the connection while the server initiates the connection request. See http://www.sysnucleus.com/usbshare/help/callbackconnection.htm to know more about callback connections.

Download and try the 15 days evaluation copy of USBDeviceShare USB over Ethernet software from http://www.sysnucleus.com/usbshare/usbshare_download.html.

USBTrace : Test and Measurement Class Decoder

sysnucleus — Tue, 10 Jul 2012 08:39:09 +0000

USB Devices which belong to the the Test and Measurement (TMC) device class can be analyzed using the TMC decoder plugin DLL. The TMC subclass, USBTMC USB488 Interface, is also supported.

The following class specific requests are decoded :

INITIATE_ABORT_BULK_OUT
CHECK_ABORT_BULK_OUT_STATUS
INITIATE_ABORT_BULK_IN
CHECK_ABORT_BULK_IN_STATUS
INITIATE_CLEAR
CHECK_CLEAR_STATUS
GET_CAPABILITIES
INDICATOR_PULSE
READ_STATUS_BYTE
REN_CONTROL
GO_TO_LOCAL
LOCAL_LOCKOUT

The following Bulk-OUT messages (commands) are decoded :

DEV_DEP_MSG_OUT
DEV_DEP_MSG_IN
VENDOR_SPECIFIC_OUT
VENDOR_SPECIFIC_IN
TRIGGER

The following Bulk-IN messages (responses) are decoded :

DEV_DEP_MSG_IN
VENDOR_SPECIFIC_IN

Interrupt messages (notifications) are also decoded.

Download and try the free 15-days evaluation copy of USBTrace USB Analyzer to know more about the features.

How to scrape text following a heading using WebHarvy ?

sysnucleus — Tue, 24 Apr 2012 05:48:53 +0000

In the latest update of WebHarvy, the Visual Web Scraping Software, the newly introduced ‘capture following text’ option allows you to capture text/block/paragraph following a heading within a webpage.

Often with many websites the data to be scraped may not be located at the same position within all pages, but is guaranteed to be found under a given heading (Example : “Technical Details”, “Product Specification” etc). Sometimes, the text under a given heading may not be selected as a single item during configuring. In such scenarios the ‘Capture following text’ option in the capture window will provide helpful.

How to ?

While in configuration mode, click on the heading and select the ‘Capture following text’ option in the capture window. Provide a suitable name for the field and hit OK. In the preview pane you will be able to see the text following the heading captured.

Refer http://www.webharvy.com/tour1.html#ScrapeFollowingText for more details.