|
Frequently Asked QuestionsQuestionsError MessagesHow can I use Intex Autodnld?You can open a command window by typing cmd.exe in windows run menu. In the command window, change directory to your autodnld /scripts/ directory and use either: autodnld -config
or
autodnld -t
and follow the directions inside. Autodnld will test your connectivity.
Make sure that your autodnld.ini file connection uses ship.intex.com.
Your firewall should allow https traffic to pass through to ship.intex.com. We suggest that you open your firewall firewall to *.intex.com:443.
For clients whose https connection requires uses a proxy server, you can add this line to autodnld.ini file: http_session_header=HTTPS_PROXY=ProxyIP:ProxyPort|HTTPS_PROXY_USERNAME=proxyusername|HTTPS_PROXY_PASSWORD=proxypassword
If you use a proxy that doesn't need any username/password credential, then you can use:
http_session_header=HTTPS_PROXY=ProxyIP:ProxyPort
On Windows and Unix/Linux, you can instead use the native CURL command to connect to Intex. CURL has many more options for configuring simple and complicated internet connections.
unix_https_curl=1
On Windows, you can instead use the proxy settings used by your browser (WinInet Layer) and thus avoid entering your proxy server configuration manually as follows:
win_https_wininet=1
The autodnld log, stored in /autodnld/log/autodnld.log, is usually shortened to save space and computer resources. If you are debugging autodnld, please add suppress_log=n
httpdump=1
to your autondld.ini file.
EC:2014 other kinds of timeout during http download?This error happens during the following scenarios:Solution: either change autodnld temp folder location to a directly attached drive or add this parameter into your autodnld.ini file: timeout=600
and gradually increase this parameter until the timeout issue goes away. Note that timeout is only supported by verion 5.03/u or later.
Is the download stopped?If you think that autodnld may not be downloading any data, check to make sure that the size of /autodnld/temp/tempBuf.bin is changing. Autodnld temporarily stores data in tempBuf.bin before unpackingHow to use sendEmail utility?Autodnld default uses blat.exe to send email for window users. In a command line window change the directory to the /autodnld/scripts/ directory and type:blat /?
to find all the options that can be customized by blat.exe.
Starting with autodnld version 5.04/5.04u, Autodnld included sendEmail utility to help clients whose SMTP requires TLS or other options that blat.exe doesn't support. Inside autodnld scripts folder, Windows users can type sendEmail /?
For Linux/Unix user, type perl sendEmail -h
to see all the options that can be used. To use sendEmail instead of blat.exe, Windows users have to add the following line into their autodnld.ini file:
mail_exe=sendEmail
This is not needed for Autondnld Linux/Unix version because sendEmail is the default email utility for autodnld Linux/Unix version.
The following are recommended steps to configure sending emails: First, use a command line window to customize any options needed to make sure you can send a test email to your mail server using either blat.exe or sendEmail. Second, add the following options into autodnld.ini file using a text editor, or running "autodnld -config" email_to=joe1@mymailserver.com,joe2@mymailserver.com
mail_sender=autodnld_machine@mymailserver.com
mail_server=mymailserver.com
Additional options can be passed in using the paramter mail_exe_option:
For example, if your mailserver requires TLS and authentication username/password, autodnld.ini should have these lines (order can be different): mail_exe=sendEmail
mail_exe_option=-o tls=yes -xu joeusername -xp joepassword
email_to=joe1@mymailserver.com,joe2@mymailserver.com
mail_sender=autodnld_machine@mymailserver.com
mail_server=mymailserver.com
Additional information can be found: mail_exe_option
Download inf file failed in "autodnld -t" test (applies to https download)At the end of "autodnld -t" test, you got message:https test success! You can open c:\intex\autodnld\temp\ to confirm that it can be unzipped correctly.
Download your inf file failed. Please check your password, or contact autodnld_help@intex.com
Download cmo shipment failed but other file downloading seems OK (applies to https download)In some cases "autodnld -t" works, autodnld could access shipment directory and download shipinfo.zip file and other perfdata,histdata, etc. However, autodnld could not download the cmo shipment and got "EC1010 connection error".This is usually caused by Intex redirecting your shipment to a different server for load-balancing. Please confirm that your firewall allow list contains *.intex.com. How can I fix a "unpacking" or "uncompressing" file error?If you are running Windows, make sure you are running version 4.02 or higher. If you are running UNIX, make sure you have symbolic links for gzip, tar and unzip in the autodnld/scripts subdirectory.Regardless of operating system, make sure the compressed file was fully downloaded. It should be inside the temp directory used by autodnld. Try uncompressing it manually to make sure it is not damaged. For example, the following command would unzip a .Z file: autodnldScriptsPath\gzip.exe -cdf SourceFile > DestinationFile
"Cannot see subdir" error?You get an email similiar to the following:Error downloading #### file
Remote file was /####/../pooldata/mbsstat.qa
Local file was \\sharedpath\cmo_cdu\mbspools\mbsstat.qa
-- start traceback from DownloadFile() Cannot see subdir=MISSING_SUBDIR
(Already tried to create it)
We retried 1 times
-- end traceback from DownloadFile()
This error is caused by directory write privilege issues or the directory running out of space. Try:
How do I upgrade my version of autodnld?Please use the sidebar link for Upgrade Instructions.How do I find out what version of autodnld I am running?You can runautodnld -v
to find out the version.
The emails and log files for autodnld also include the version number.
We missed some shipments due to technical problems; what should we do?There are no additional steps required if you were only off-line for a few days. Just run autodnld, and it will download any missed shipments.Autodnld creates a DBStatus report at the end of each download. This report contains a list of any files that are missing or out of date on your system. If autodnld creates a dbstatus report, please email it to autodnld_help@intex.com, and Intex will include any missing files in your next shipment. Autodnld checks for new versions of remit data files on each run, and will will automatically update any missing or damaged files. How can I detect when file(s) have been downloaded without using email?You can find the contents of email messages (even if the weren't actually sent) in /autodnld/log/email.log.For CMO data, you can check the age and the contents the DBStatus report, which is in /autodnld/log/dbstatus.rpt. How can I troubleshoot sending emails on Windows?If autodnld is having trouble sending emails, and if you are running under Windows, we suggest a multi-step debugging process:
Autodnld uses an open source program called "blat.exe" to send emails. The program resides in autodnld scripts directory. If you are having problems sending email, you can try running blat in a command window to test the sending of email. Open a command line window. cd to Autodnld scripts directory. Type: blat /?
It will give a lot of options that you can use with blat program,i.e., how to specify a port, file with the message body, etc.
Here is one quick test you can run:
blat.exe - -body "This is a test" -t your_recipient -s "test" -f your_sendername -server yourSMTPServerNAME
Be sure to use a hyphen (-) as your first argument, followed by -body "your message" if you don't want to send a file.
You will see something like this if the mail is sent successfully. Blat v2.4 w/GSS encryption (build : Jan 15 2005 08:32:11)
Sending stdin.txt to your_recipient
Subject: test
Login name is your_sendername
If you see any error, you have to work with your mail server administrator to figure out why. We are downloading pooldata for the first time; what do we do?Autodnld will automatically download and create the necessary directories for pooldata. You will also need to allocate more disk room for Intex data. Please contact Intex at autodnld_help@intex.com for information on how much data to expect.You may want to purge pooldata by adding a line to the ini file: pool_data_purge We are downloading mbspooldata, does dbstatus check mbs pools? Is there a separate check for pools?There is a separate report for MBS pool data files. It is stored in /autodnld/log/mbsstat.qa. If you receive emails from autodnld, you will receive an email listing missing mbspool files.Does Autodnld support replicating Intex ship data to another location?Autodnld no longer supports the replication feature. Intex recommends that clients look to their own IT support for a suitable backup/replicate solution.How do I set up autodnld so that I can run it from a pair of redundant machines?To do this, you need to install autodnld on a network drive that all the machines can see. Then run autodnld normally from the network drive on each of the redundant machines.By running autodnld off a network drive, autodnld will log and download files, so the the same shipment twice is not processed twice. How can I control which CMO shipments autodnld will pull?Change to the autodnld\scripts subdir. Then runautodnld.exe -c"
on Windows. Unix clients should use
perl autodnld.pl -c
This will mark all available shipments as processed. Then change to the autodnld\log subdir and edit the file "CMOTrack.log".
Remove the lines containing the shipments you would like to download. Finally, run autodnld normally and download the selected shipments.
Where do I find the list of files being downloaded in each shipment?If you have save_serialized_zip_files=1 inside your autodnld.ini file, autodnld saves shipinfo.timestamp.zip inside the log directory. The timestamp is a ten digit UTC number so it will change from shipment to shipment.You have to make sure to delete zip file by themselves afterwards to make sure they don't run out of disk space later. Inside this .zip file is a file shiplist.txt. This file contains a list of the files downloaded in this shipment. Shiplist.txt is a "|" delimited file with 3 columns: 1) The location of the file on the Intex server for Autodnld purposes 2) The name of the file stored in your Intex data directory 3) the size of the file in KB What directory permissions do I need to set for autodnld to runUnder Windows, autodnld runs with a user and password as set by the job scheduler. Under UNIX, autodnld runs with a user and password as set by crontab.In either case, autodnld unpacks a zip file, and tries to either overwrite or to create new files in cmo_cdi and cmo_cdu directories within your Intex data directory. To find out the location of your cmo_cdi and cmo_cdu subdirectories, you can look at the /autodnld/scripts/autodnld.ini file. You should set the rights on the cmo_cdi and cmo_cdu subdirectories to allow file and/or subdirectory creation by the user that autodnld is running as. Keep access read-only for your end users. If I am an intraday client, and all the intraday shipments are downloadeded successfully, why do I need to redownload those files at the end of the day?The Intraday download directory on the Intex server will be purged every day at 4:00 PM EST. To guarantee clients have the complete data set, all intraday shipments will be included again in the nightly shipment.Where do I find the list of files being downloaded in intraday shipment?The autodnld\log\intraday\shiplistDone.txt file keeps track of the intraday files being downloaded each day. This file is erased if a new regular shipment is found on intex server.Alternatively, if you have save_serialized_zip_files=1 inside your autodnld.ini file, autodnld saves shipinfo.timestamp.zip inside log/intraday directory. shiplist.txt is inside this zip file. The timestamp is a ten digits UTC number. So it will change during the day. You have to make sure to delete zip file by themselves afterwards to make sure they don't run out of disk space later. ERROR: we could not erase the lock file; another process is holding it openWe use a lock file to prevent multiple instances of autodnld from running at the same time on Windows. As autodnld starts it must be able to erase this file if it exists. Autodnld then opens a file with this name for write, and holds it open until the autodnld cycle is complete. It then closes the file and erases it. The lock file is stored at /autodnld/log/autodnld.is.running.txt. If you receive a lock file error, you probably have a instance of autodnld.exe that is already running that you have to kill. To do so, press ctrl-alt-delete, and click on the "Task Manager" button. Press the "Processes" tab, and look for
If there are no autodnld related process running and autodnld still cannot delete the file, rebooting your computer usually resolves the issue. What causes an error like: PKZIP: (W1) Warning! can't create: cmocusip.inf?Please see the FAQ regarding upacking or uncomparessing files available hereWhat causes the error "Unknown host" in my autodnld.log file or my screenCheck your /autodnld/scripts/autodnld.ini file to make sure that your connection paramter is set to ship.intex.com. If this is set up correctly, try running autodnld in test mode:autodnld -t
This will provide any additional details on issues that autodnld encounters.
The unknown host error may also be an indication that your Domain Name Service (DNS) is not configured correctly. Autodnld seems to run OK, but the dbstatus program doesn't run properlyAt the end of a successful download of CMO data, the dbstatus program is run by the autodnld script. DBStatus compares your copy of Intex data against the master files at Intex, and produces a report, stored in /autodnld/log/dbstatus.rpt, of any missing or damaged files. DBStatus uses cmo_cdu/mbsstat.qa for the comparison.To troubleshoot DBStatus issues, try:
====================================
Data was dated Mon Aug 6 22:08:34 EDT 2001
Had trouble downloading data file, or unpacking it
---- Traceback
There were errors when decompressing
file=D:\Sharetree\FixedIncome\Intex\Data\cmo_cdu\cmo_cdu.000055.zip (file in
use?)
--- Traceback:
ERROR: had error return code from decompress program;
cmd=D:\Sharetree\FixedIncome\Intex\AutoDnld\scripts\pkzip32.exe -extract -nofix
-over=all -directories
"D:\Sharetree\FixedIncome\Intex\AutoDnld\temp\cmo_cdu.000055.zip"
D:\Sharetree\FixedIncome\Intex\Data\cmo_cdu 2>
D:\Sharetree\FixedIncome\Intex\AutoDnld\log\pkzip32_stderr.txt; value=11520
--- start: stderr lines from
cmd=D:\Sharetree\FixedIncome\Intex\AutoDnld\scripts\pkzip32.exe -extract -nofix
-over=all -directories
"D:\Sharetree\FixedIncome\Intex\AutoDnld\temp\cmo_cdu.000055.zip"
D:\Sharetree\FixedIncome\Intex\Data\cmo_cdu 2>
D:\Sharetree\FixedIncome\Intex\AutoDnld\log\pkzip32_stderr.txt
--- end lines
===================================
you should try unzipping the file by hand in a command window, so you can see any errors happening.
You can find the command that autodnld executed by searching for the "cmd=" line in the autodnld.log file.It may be easier to create a batch file, since the paths are so long. For the case above, you would put yourself in the autodnld\scripts directory and run this command: pkzip32.exe -extract -nofix -over=all -directories D:\Sharetree\FixedIncome\Intex\AutoDnld\temp\cmo_cdu.000055.zip D:\Sharetree\FixedIncome\Intex\Data\cmo_cdu
Any errors that happen should appear in the window as the command runs ... you might have to press control-s to freeze the output so you can read the error. You may need to adjust your command windows settings to show enough history to view the entire process.
uncompressing or unpacking a data fileSee FAQ: How can I fix a "unpacking" or "uncompressing" file errorerror 10060 from WinSockThe name of your mail server is incorrect. Please consult the windows email debugging FAQ.Did autodnld Run Without Errors?Autodnld will send you an email if it encounters an error during a run, and is configured to send email. See the manual for more information emails and autodnld. You can also check three of the autodnld log files in the /autodnld/log directory:
Intex also provides optional Shipment Emails to alert you when a shipment is available, and when you have a shipment pending for a few days. To enable this feature, please contact Intex at autodnld_help@intex.com and ask to turn on shipment emails. "file in use" errorsOn Windows, autodnld cannot replace a file that is in use. Autodnld will keep files that it could not copy within the /autodnld/temp/ directory, and will try to copy the files again during its next run. If the file is continuously in use, you will begin to receive DBStatus reports since the file is out of date. |