This topic has been archived. It cannot be replied.
-
工作学习 / IT技术讨论 / unix admin请进,谢谢!unix and sybase
目前的情况是每天晚上有很多文件从mainframe传过来然后load into sybase. 现在想改成把那些files先compress再传过来,然后decompress-->load into sybase.
现在要求investigate可行性,我可是unix白痴啊,一点头绪都没有,请大家帮忙了,多谢多谢!
-zxcvb(朝天椒);
2005-3-30
{249}
(#2210484@0)
-
why compress, it will take much long time CPU time for compress and decompress.cmd for select:
gzip (most new unix installtion have it)
to compress:
gzip < inputfile > inputfile.gz
to decompress:
gzip -cd < file.gz > file
Compress (unix standard)
always remove the orignal file after compressed file is created. and visa versa.
-647i(路遇*神,卡片遗失一);
2005-3-30
{261}
(#2210509@0)
-
太谢谢了,这个take much long time CPU time for compress and decompress可以从哪里找到出处吗?
-zxcvb(朝天椒);
2005-3-30
(#2210529@0)
-
it depend on if your cpu is powerful enough. normally the throughput of compress is slow than your network card (100Mb/s). you can have test, how long does it take to cmpress an 100MB file on your server.
-647i(路遇*神,卡片遗失一);
2005-3-30
(#2210574@0)
-
非常感谢
-zxcvb(朝天椒);
2005-3-30
(#2210581@0)
-
可以的啊,关键是两边要用同样的压缩工具
-pasu(InTheSky);
2005-3-30
(#2210514@0)
-
谢谢,我会把这个写进去
-zxcvb(朝天椒);
2005-3-30
(#2210537@0)
-
tar-czvf compressed.tar.gz -----> tar xzvf decomrepssed.tar.gz
-canadiantire(轮胎-M.I.N.K.);
2005-3-30
(#2210524@0)
-
谢谢,decompress会不会让processing慢下来?
-zxcvb(朝天椒);
2005-3-30
(#2210545@0)
-
compress need more cpu resource and disk space...be careful.
-pipibug(golf);
2005-3-30
(#2210556@0)
-
thanks a lot
-zxcvb(朝天椒);
2005-3-30
(#2210562@0)
-
tar use gzip to compress and decompress, it will slow down CPU a bit for sure.
-canadiantire(轮胎-M.I.N.K.);
2005-3-30
(#2210564@0)
-
谢谢
-zxcvb(朝天椒);
2005-3-30
(#2210567@0)
-
Mainframe上的tar 不是很方便,一则tar只能在USS(Unix System Service)之下使用,MVS文件需要先倒过去.二则tar需要特别的EBCDIC- ASCII字符转换.对于传统的MVS文件使用PKZIP看来最合适.
-unknown2me(行者);
2005-3-30
(#2211506@0)
-
专家,谢谢!
-canadiantire(轮胎-M.I.N.K.);
2005-3-30
(#2211627@0)
-
我这里就用此招,我们两边(z/OS 和 AIX)都用zip/unzip。给你一个可用于mainframe的免费ZIP,UNIX的ZIP一抓一大把。压缩的好处在于节省你的网络上传输的时间。。。
-unknown2me(行者);
2005-3-30
{401}
(#2210930@0)
-
谢谢,确实是传大文件,说是俺们这传送慢影响另外一个system(不知道这结论是如何得出来的),可我们这里的CPU和disk space一直都有问题,我真是希望多一事不如少一事
-zxcvb(朝天椒);
2005-3-30
(#2210946@0)
-
如果是单个大文件,我建议还是直接传送好了。mainframe的CPU和I/O很贵的。多一事不如少一事阿。
-lionel(Lionel);
2005-3-30
(#2212187@0)
-
好.你终于出手了.
-scottee(笑熬浆糊);
2005-3-30
(#2211022@0)
-
小李飞刀!
-zxcvb(朝天椒);
2005-3-30
(#2211071@0)
-
给饭爷作个广告: 你可以到他那里申请OS/390 和UNIX的帐号, 然后在他的系统上试一试.
-unknown2me(行者);
2005-3-30
(#2211515@0)
-
具体机器和网络环境都不一样呢
-pasu(InTheSky);
2005-3-30
(#2211571@0)
-
呵呵,正好有好多问题要向你请教呢。。。这几天埋头研究整理以前做过的CICS代码。。。。并且想问问看你那里有没有DITTO.
还有就是我手工起了IMS,主控台信息是
*19.13.18 DEMOPKG STC08080 *09 DFS996I *IMS READY* IMSA
但好像连接还是有问题。。。何故?
-thisunreal(饭得志);
2005-3-30
{135}
(#2212132@0)
-
还有一种方法你可以考虑:生成文件的时候就直接压缩,这样省了个写大文件的步骤,速度要快一点。例如oracle:
exp .... | gzip ...
-holdon(try again);
2005-3-30
(#2211699@0)
-
gzip has options to fast up/slow down the compress CPU usage. for fastest compress time use -1 option. for best compress rate use -9 option. In your case u can use -1 option to have test.the defualt compess rate( as I remember) is 6. the time comsumption between may be 1:2, compress rate may be 1:1.3. it is depend on the file you compress.
-647i(路遇*神,卡片遗失一);
2005-3-30
{154}
(#2212202@0)
-
谢谢楼上各位了!
-zxcvb(朝天椒);
2005-3-31
(#2212662@0)