63 Commits

Author SHA1 Message Date
Ryo Nakamura
dca0241824 add O_TRUNC when the first open() for a file 2022-11-18 22:30:34 +09:00
Ryo Nakamura
f4d04b848e don't stop on macos whem -m coremask is set 2022-11-18 22:24:46 +09:00
Ryo Nakamura
04ae5ee1dc remove pr_warn debug 2022-11-18 21:52:58 +09:00
Ryo Nakamura
71efeaa4ba fix type of id for sftp_async_write 2022-11-18 20:33:50 +09:00
Ryo Nakamura
5e7aa774ca fix when copy multiple sources and various tiny fixes
* when copying multiple sources, target must be directory
* add multi-src copy test and parametrize src/dst prefixes
* cleanup REAMDE (s/sessions/connections/g)
* make error output in copy functions simple
2022-11-18 20:20:19 +09:00
Ryo Nakamura
b8d58b1fba tiny fix
- set ssh nonblocking before closing sftp session
- fix pprint for core mask
2022-11-18 13:47:24 +09:00
Ryo Nakamura
5ede4dc122 fix async handling 2022-11-17 23:46:51 +09:00
Ryo Nakamura
2d66f4ca14 fix idx increment (typo) and async write improves copy speed! 2022-11-17 22:09:59 +09:00
Ryo Nakamura
d448f9eb8a implement local-to-remote copy with async_write 2022-11-17 21:46:21 +09:00
Ryo Nakamura
41da0c5cfe check invalid coremask 2022-11-16 01:57:27 +09:00
Ryo Nakamura
a69115a4dc add -m coremask option 2022-11-15 19:57:53 +09:00
Ryo Nakamura
e9d5ceb462 add memory barrier to notify monitor thread of copy threads finished 2022-11-13 15:33:45 +09:00
Ryo Nakamura
81a7fbd2d8 add -a nr_ahead option 2022-11-13 15:31:12 +09:00
Ryo Nakamura
cfbbae860c little trick to make progress bar stable 2022-11-12 17:45:08 +09:00
Ryo Nakamura
756e0759f9 fix buf size in remote to local copy.
Too large buffer size for sftp_async_read causes unfinished copy:
sftp_async_read returns 0 althrough data remains.
2022-11-12 17:30:51 +09:00
Ryo Nakamura
71d827d613 fix some thread handling 2022-11-12 16:11:20 +09:00
Ryo Nakamura
73e884f9c5 use sftp_async_read for remote to local copy 2022-11-12 15:30:01 +09:00
Ryo Nakamura
8eb9e69c1c fix incorrect ret handling for read/write 2022-11-08 10:06:30 +00:00
Ryo Nakamura
243bf1fa57 add -H option to disable host key check
tests use this option.
2022-11-05 22:46:02 +09:00
Ryo Nakamura
6e6e5066c7 create file at the remote although file size is 0 2022-11-05 19:13:53 +09:00
Ryo Nakamura
d62fc2cddd do not print progress when total bytes transferred is 0 2022-10-31 15:30:42 +00:00
Ryo Nakamura
7039b84c4f capture retval from copy threads 2022-11-01 00:17:05 +09:00
Ryo Nakamura
44ed580f4d add rename-logic.py 2022-10-31 22:55:43 +09:00
Ryo Nakamura
926688e849 rename dirname if dst dir does not exist
`scp remote:srcdir dstdir` renames srcdir to dstdir if dstdir does
not exist. If dstdir exists, it creates dstdir/srcdir.
This commit imitates this behavior.
2022-10-31 22:51:39 +09:00
Ryo Nakamura
e997d692c2 set nr_threads to # of chunks if # of chunks is small 2022-10-30 12:27:58 +00:00
Ryo Nakamura
453e8f27ce add cpack to build debian package 2022-10-30 12:17:17 +00:00
Ryo Nakamura
96c10a700a fix on debug compile 2022-10-30 07:41:49 +00:00
Ryo Nakamura
b9f44bb030 Merge branch 'main' of github.com:upa/mscp 2022-10-30 15:22:17 +09:00
Ryo Nakamura
c495f6b89b rename sscp to mscp 2022-10-30 15:20:05 +09:00
Ryo Nakamura
65bdbdaede little refactoring for param names 2022-10-30 06:13:02 +00:00
Ryo Nakamura
5d848ccab1 fix int overflow 2022-10-30 05:47:21 +00:00
Ryo Nakamura
37c37990f5 use sftp_get_ssh_error 2022-10-30 00:02:21 +09:00
Ryo Nakamura
c76fa3141d change indent from space to tab 2022-10-29 23:48:50 +09:00
Ryo Nakamura
ff697aa514 fix path handling 2022-10-29 23:36:12 +09:00
Ryo Nakamura
47f6983148 wrap print progress in pprint 2022-10-25 01:47:39 +09:00
Ryo Nakamura
c83927cd5a add copy start and done output
These fputs should be wrapped in a function and protected by a lock. todo.
2022-10-25 00:14:47 +09:00
Ryo Nakamura
7ca4a85b76 fix miss flag handling for threads[n].finished 2022-10-25 00:04:59 +09:00
Ryo Nakamura
8d7e6fe016 todo: consider smp for counters 2022-10-24 23:50:00 +09:00
Ryo Nakamura
962542bd9c adjust order of thread spawning 2022-10-23 21:53:41 +09:00
Ryo Nakamura
79e717d1ed configurable sftp_buf_sz.
default value 131072 is derived from qemu/block/ssh.c.
we need more investigaion.
2022-10-23 21:43:44 +09:00
Ryo Nakamura
e6339bf464 cleanup copy codes 2022-10-23 19:11:07 +09:00
Ryo Nakamura
0213b316c5 compilable on linux 2022-10-23 16:42:20 +09:00
Ryo Nakamura
7c18d42004 bps to byte/s 2022-10-23 16:10:07 +09:00
Ryo Nakamura
03a20c77d8 spawn monitor thread before copy threads 2022-10-23 16:05:49 +09:00
Ryo Nakamura
77e977ce8e fix a signifiant bug 2022-10-23 16:04:50 +09:00
Ryo Nakamura
b79e20e54d handle permission on open 2022-10-23 16:00:55 +09:00
Ryo Nakamura
d11ac58f4b compilable in linux 2022-10-23 15:51:21 +09:00
Ryo Nakamura
99b2bca7e5 fix usage 2022-10-23 01:21:44 +09:00
Ryo Nakamura
3849cc6bc6 fix on progress bar 2022-10-23 01:16:03 +09:00
Ryo Nakamura
75a1d8e737 add progress bar 2022-10-23 01:08:40 +09:00