Subject: bug#35401: Decompressing File

From: "Davis, Marvita" <[email-masked]>
Date: Wed, 24 Apr 2019 13:52:03 +0000

Interestingly enough I've read that the SFTP protocol downloads in binary by default ...  but clearly that is not happening here .

When I try to change to either mode ... neither is recognized as a valid command.  This worked with FTP.  Has something changed?

Connected to sftp.bloomberg.com.
sftp> binary
Invalid command.
sftp> ascii
Invalid command.
sftp>

-----Original Message-----
From: Dagobert Michelsen <[email-masked]> 
Sent: Wednesday, April 24, 2019 4:24 AM
To: Davis, Marvita <[email-masked]>
Cc: [email-masked]; Mishra, Subha <[email-masked]>
Subject: Re: bug#35401: Decompressing File

Hi Marvita,

Am 23.04.2019 um 20:03 schrieb Davis, Marvita <[email-masked]>:
> I am having issues decompressing the ".gz" files on our side.  These are files generated by Bloomberg.  Bloomberg is able to decompress on their end with ... "gunzip -d -k dFIR_20190329110022.dat.gz" ... and have helped me out by sending the output file.  Here is the output when trying various commands.  Same output for all files.
>
> njbgceis-zd1:/export/home/secbatch/data/FIR>%  gunzip -d -k 
> dFIR_20190329110033.out.gz
>
> gzip: invalid option -- 'k'
>
> Try `gzip --help' for more information.

The -k options is probably from another implementation, it shuld be safe to skip it.

> njbgceis-zd1:/export/home/secbatch/data/FIR>% gunzip  
> dFIR_20190329110033.out.gz
> gzip: dFIR_20190329110033.out.gz: not in gzip format
>
> Can someone confirm the  format?  Is it possible format changed on SFTP from Bloomberg to local machine.

The file is most certainly not in GZIP format, often ASCII transfer is used for SFTP instead of binary which should have been used. ASCII mode for transfer changes line ending characters invalidating the file data, so please check if you have selected binary transfer.

Best regards

  — Dago

--
"You don't become great by trying to be great, you become great by wanting to do something, and then doing it so hard that you become great in the process." - xkcd #896

----------------------------------------------------------------------
CONFIDENTIAL 
An electronic communication(s)/message(s), including its contents and attachments, if any, may contain privileged or confidential information, or may be otherwise protected by work product immunity or other legal rules.  No confidentiality or privilege is waived by any erroneously transmitted communication.  Accessing, copying or re-using of information by non-intended or non-authorized recipients is prohibited.  If you are not the named recipient please notify the sender and immediately delete this communication.  You may not disseminate, distribute, or forward this message or disclose its contents to anybody else. Copyright and any other intellectual property rights in its contents are the sole property of BGC Partners Inc.  and its affiliates (collectively, “BGC,” “we,” or “us”).

MAY CONTAIN ERRORS AND/OR VIRUSES
Electronic communications/messages cannot be guaranteed to be secure or error-free.  The sender therefore does not accept liability for any errors or omissions in the contents of this message, which arise as a result of such transmission.  If verification is required, please request a hard-copy version.

Although we routinely screen for viruses, recipients should check this communications/message and any attachments for viruses.  We make no representation or warranty as to the absence of viruses in this e-mail or any attachments.  Please note that, to ensure regulatory compliance and for the protection of our customers and business, we may monitor and read e-mails sent to and from server(s) used by us.

INFORMATION PURPOSES ONLY
The information contained in this electronic communication/message and any attachments is for information purposes, and should not be regarded as an offer to sell, or a solicitation of an offer to buy, any security in any jurisdiction where such an offer or solicitation would be in violation of any local laws.  It does not constitute a recommendation or take into account the particular investment objectives, financial conditions, or needs of specific investors.  Any prices or data contained herein are indicative and do not represent where the underlying instrument(s) may trade in the market at any given point in time, nor does such price(s) represent a determination of the underlying value of a particular instrument(s).  This information may be changed at any time without notice or obligation to update.  BGC accepts no liability for any loss (whether direct, indirect or consequential) that may arise from any use of the information contained herein or derived herefrom.  Reliance may not be placed on trade confirmations issued other than by our Operations Department. 

RETENTION
Please note that any electronic communications/messages conducted within or through BGC systems is subject to monitoring, review, retention, and external production.

BGC Financial LP is a broker-dealer registered with the U.S. Securities and Exchange, a member of FINRA and a member of SIPC.

BGC Financial LP is a member of the National Futures Association as a swap firm and a futures commission merchant.   

BGC Derivatives Markets LP is a swap execution facility registered with the Commodity Futures Trading Commission.

BGC Brokers LP ("BGCB") is authorised and regulated by the Financial Conduct Authority ("FCA"). BGCB is a Limited Partnership formed under the laws of England (under Limited Partnership Act 1907 LP011453) and its VAT registration number is 577 406809. BGCB's registered office is at 12 Endeavour Square, London, E20 1JN. For any issues arising from this email please reply to the sender.

BGCB appears on the FCA register under no 454814. The FCA register appears at www.fca.org.uk/register.  The FCA is a financial services industry regulator in the United Kingdom and is located at 12 Endeavour Square, London, E20 1JN.

An individuals’ personal data under the GDPR - For further information about the way BGC entities (and relevant affiliates)  within the European Economic Area (EEA) use your personal data please see our Third Party Privacy Notice at www.bgcpartners.com/notices/ or at such other place as we may provide notice of from time to time.
Marketing within the European Economic Area - BGC entities within the EEA may contact you about industry news, offers and information relating to their products and services which they think would be of interest to you. You can tell them you do not wish to receive such communications by forwarding the communication to the following applicable regional address:

US - [email-masked]
EMEA - [email-masked]

For additional disclosures, please visit http://www.bgcpartners.com/disclaimers/