WebHarvy version 3.4 released !

We’ve just released a new WebHarvy update. The following are the changes in this version.

Major:

  1. Support for pagination where a link/button has to be clicked to load the next set of pages
  2. URL based pagination – automatically increment a numeral in start page URL to load subsequent pages
  3. One-click multiple image extraction from details pages (ex: capture multiple images from product details page)
  4. Human emulation mode support for automatic pause injection
  5. Online license activation introduced to prevent casual piracy

Minor:

  1. ‘Click’ option (Capture window > More Options > Click) can be used to navigate to the start page
  2. Bug Fix : Data alignment issue in miner window data table when some records fields do not have a value (blank columns)
  3. Bug Fix : Keyword based scraping when encoding is required
  4. Scheduler option to overwrite or append the export file in case the file already exists
  5. ‘Follow this link’ option enabled in details pages (pages reached by following links from starting page).
  6. Bug Fix : Images going blank in some cases while mouse hovers over them during configuration
  7. Bug Fix : New lines and tabs escaped in JSON export
  8. HtmlParser updated to parse elements from <HTML> tag, so META tags can be extracted from the full HTML source of the page
  9. Handles commas in keywords (Keyword Scraping)
  10. Starts with a random proxy address from the proxy list while rotating proxies
  11. In-built browser emulates IE 11 on default.

Download the latest version of WebHarvy Web Data Extraction Software.

Posted in Release update, WebHarvy | Tagged , , , , , , , | Leave a comment

USBDeviceShare 3.0 released

We have released a major update of USBDeviceShare – the USB over Network software for Windows. USBDeviceShare allows you to share USB devices and access them remotely over network (LAN) or internet.

USB Device Share

The major changes in this version are :

  • Updated Server and Client drivers to work with latest Windows versions – Windows 8/8.1
  • Supports USB 3 device sharing
  • Minor UI updates
  • Server device stub driver is loaded for USB devices only when initiated by Server application. Prevents automatic loading of stub driver for newly plugged devices.
  • Completely removes stub driver during uninstallation
  • Fixed issue with connection initiation from Client/Server by remote computer name

The latest version may be downloaded from http://www.sysnucleus.com/usbshare/usbshare_download.html.

Posted in Release update, USBDeviceShare | Tagged , , , | Leave a comment

Run USBDeviceShare as Service

This article explains how USBDeviceShare Server and Client applications can be run as service, so that they can operate automatically, sharing and remotely accessing devices on system start up, without requiring a user to log in to windows to start them.

Please note that USBDeviceShare Server and Client applications do not have this functionality built in, so an external tool provided by Microsoft is used to achieve this – https://support.microsoft.com/KB/137890. Here is how :

1. Download Windows Server 2003 Resource Kit Tools from http://www.microsoft.com/en-us/download/details.aspx?id=17657

2. Extract the contents of the downloaded file to a suitable folder on your PC.

3. Open command prompt (in administrative mode) and change directory to the above folder.

4. Run the following command

instsrv UShareSrv <full path to srvany.exe>

Both instsrv.exe and srvany.exe are tools available in Windows 2003 Resource Kit Tools. UShareSrv is the name given to the service which we are creating. The last parameter is the full path of the the application srvany.exe. For example :

instsrv UShareSrv “c:\downloads\Windows 2003 Kit Tools\srvany.exe”

The above command will create a service named UShareSrv which runs the executable srvany.exe.

5. Open RegEdit (Windows Registry Editor) and find the following key

HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Services\UShareSrv

6. Create a key named ‘Parameters‘ under the above key

7. Within the newly created “Parameters” key , create a string (REG_SZ) value called “Application” and enter the full path to the application which you require to run as a service, no quotes required for full application path. (ex: c:\program files\usbdeviceshare-server\usbdeviceshare-server.exe).

8. Open ‘Local Service Manager’ (View Local Services), locate the service (UShareSrv) which we created. Right click > select ‘Properties‘. Open ‘Log On‘ tab. Select ‘This account‘ option and set the account name / password under which you are planning to run USBDeviceShare (ideally the currently logged in account). Save changes and close.

9. Run the application (USBDeviceShare-Server in this case) from the account selected in above step and create the initial settings – for example set the devices to be automatically shared on start up.

10. Restart windows. Server should start with the options set in above step even before user is logged in – as a service.

The same steps can be applied to run Client as a service. Please try and contact our support in case you need any technical assistance or have any questions.

Posted in USBDeviceShare | Tagged , | Leave a comment

Web Scraping from Cloud – WebHarvy on Amazon EC2

WebHarvy requires Windows operating system to run. So in case you do not have access to a Windows PC or if you do not want to run WebHarvy on your local PC, you have the option to run WebHarvy from Cloud. Amazon Web Services (AWS) Elastic Compute Cloud (EC2) platform makes this possible. See the following link.

http://aws.amazon.com/ec2/

Amazon EC2 lets you run a remote Windows instance in Cloud. You can access this cloud based Windows instance via Remote Desktop

http://aws.amazon.com/windows/

Charges for EC2 are minimal and more importantly there is a free tier available for 12 months with the following details.

http://aws.amazon.com/free/

Watch the following video which shows how to launch a Windows instance in Amazon EC2.

You may also watch the following tutorial which explains the same.

Detailed AWS EC2 documentation for managing Windows instances may be viewed at the following link.

http://docs.aws.amazon.com/AWSEC2/latest/WindowsGuide/concepts.html

Once you connect to the Windows instance via Remote Desktop, you can download and install WebHarvy in it. You will have to make sure that .Net 3.5 is installed in the Windows instance so that WebHarvy can run properly. Please contact us in case you need any assistance.

Posted in HowTo, WebHarvy | Tagged , , , , | Leave a comment

USBTrace – Device Class Decoders Updated

Class decoder DLLs are now bundled along with USBTrace installation. So there is no need to download and install them separately as with previous versions. The following are the changes in the latest version (3.0) of USBTrace USB Protocol Analyzer.

HID class decoder has been updated as per the latest HID Usage Table specification.

USB Hub Class decoder has been updated as per the 3.0 specification.

Mass Storage (MSD) device class decoder has been updated as per SPC 3 and MMC 5 specifications.

The video class decoder has been updated as per UVC 1.5 specification.

We have also updated the Vendor Specific Class decoder sample DLL code to work with the latest version of Microsoft Visual Studio.

The latest version of USBTrace USB Analyzer may be downloaded from http://www.sysnucleus.com/usbtrace_download.html

Posted in USBTrace, USBTrace Features | Tagged , , , | Leave a comment

Analyze USB 3.0 devices with the new USBTrace

With the latest version of USBTrace USB Protocol Analyzer Software,  you can capture and analyze USB 3.0 traffic on all versions of Windows (XP to 8.1, both 32 and 64 bit) with ease. USB 3.0 (Super Speed) enumeration traffic capture, device class decoding etc. are fully supported. The following USB 3.0 specific data are captured.

  • USB 3.0 Standard Descriptors
    • Binary Device Object Store (BOS) descriptor
    • Super Speed Endpoint Companion descriptor
    • Super Speed USB Device Capability descriptor
      • USB 2.0 Extension
      • Super Speed USB device capability
      • Container ID
  • USB 3.0 Standard device requests
    • SET_SEL
    • SET_ISOCH_DELAY

Download and try the latest version of USBTrace USB Analyzer Software for Windows from http://www.sysnucleus.com/usbtrace_download.html

Posted in USBTrace | Tagged , , , , , , | Leave a comment

USBTrace version 3.0 Released !

The latest update of USBTrace (3.0) is available for download at http://www.sysnucleus.com/usbtrace_download.html. The major changes in this release are :

  1. Fixed USB 3.0 device enumeration traffic capture issues
  2. Displays endpoint address for USB 3.0 transactions
  3. Updated HID class decoder as per the latest HID Usage Table specification (Hut1_12v2)
  4. Updated Hub class decoder : USB 3.0 hub class support
  5. Updated Mass Storage class decoder (SPC 3, MMC 5 specification)
  6. Updated Video class decoder (UVC 1.5 specification)
  7. Minor UI changes
  8. Class decoders bundled along with installer
  9. Updated USB Vendor list
Posted in Release update, USBTrace | Tagged , , , , , | Leave a comment