Ryo Nakamura
a0b7482f66
add mscp_get_stats
...
move progress bar-related functions from mscp.c to main.c.
2023-03-03 18:27:14 +09:00
Ryo Nakamura
363296f499
add mscp_ssh_opts and change -C optarg
2023-03-03 16:50:06 +09:00
Ryo Nakamura
a8af79f9cf
remove test.c
2023-02-27 10:57:10 +09:00
Ryo Nakamura
fc45fa2532
add comments to mscp.h
2023-02-26 23:56:57 +09:00
Ryo Nakamura
ca0ea3ee77
tiny fix on comment
2023-02-26 23:46:53 +09:00
Ryo Nakamura
c649742b3e
fix dst path resolve
2023-02-26 23:42:25 +09:00
Ryo Nakamura
700d64b375
now mscp links libmscp
2023-02-26 23:18:39 +09:00
Ryo Nakamura
2bad21bdc2
set default params in mscp_init
2023-02-26 18:43:24 +09:00
Ryo Nakamura
89777032cd
have written mscp.c
2023-02-26 18:17:58 +09:00
Ryo Nakamura
3d26cc2c18
add copy-related functions to path
2023-02-25 23:39:20 +09:00
Ryo Nakamura
1be9b70808
start to impliment mscp as a library
...
this commit starts to refactor file.h|c to path.h|c and
add mscp.c|h. not completed yet.
2023-02-25 22:17:29 +09:00
Ryo Nakamura
dbc96f9166
add -r option (but no effect)
2023-02-16 18:04:16 +09:00
Ryo Nakamura
fd5c6e971e
add \n at the final output
2023-02-16 17:59:26 +09:00
Ryo Nakamura
c18fb6996f
remove unnecessary pr_warn
2023-01-05 21:37:50 +09:00
Ryo Nakamura
3d98451bba
set default nr_threads to floor(log(cores) * 2) + 1)
...
This change prevents mscp from establishing too many ssh connections
on many-core machines in default.
2022-12-11 14:01:52 +09:00
Ryo Nakamura
d27db01d8d
use pthread_cleanup to acquire and release lock
...
In chunk_prepare(), if multiple threads wait for acquiring f->lock,
and then pthread_cancel() is called, the waiting threads are never
canceled because pthread_mutex_lock() is not a cancellation point.
So, use pthread_cleanup_push/pop to release the lock.
2022-12-11 13:23:41 +09:00
Ryo Nakamura
6ae3f0f9f1
set default NR_AHEAD to 32
2022-12-08 18:01:50 +09:00
Ryo Nakamura
847c80276a
fix final progress output
2022-12-06 20:04:04 +09:00
Ryo Nakamura
c4ea9a1e78
add ssh_buffer_new_size and ssh_buffer_add_func to libssh
...
sftp_async_write() with these functions reduces
1. realloc_buffer by ssh_buffer_new_size()
2. memcpy from read data to ssh buffer by ssh_buffer_add_func()
2022-12-06 15:02:14 +09:00
Ryo Nakamura
289293e812
change prompt for ssh key passphrase
2022-12-05 22:27:53 +09:00
Ryo Nakamura
1441873db6
reuse ctrl sftp session for the first copy thread
2022-12-05 21:47:00 +09:00
Ryo Nakamura
e1d14623f4
set TCP_NODELAY by default and introduce -N option to disable it
2022-12-04 21:32:48 +09:00
Ryo Nakamura
3b794ab51b
remove unused code and introduce -b buf_sz option
...
This commit removes ifdef ASYNC_WRITE. So, mscp always depends on
the patched libssh.
2022-12-03 20:48:43 +09:00
Ryo Nakamura
50c6781811
little cleanup
2022-12-02 23:35:45 +09:00
Ryo Nakamura
5846c6b6a9
cache passphrase for private key for later connections.
2022-12-02 23:20:23 +09:00
Ryo Nakamura
03a3a6dc4b
add auth callback for input passphrase of privkey
2022-12-02 22:28:56 +09:00
Ryo Nakamura
03b857b51a
add -M hmac option
2022-12-02 21:13:13 +09:00
Ryo Nakamura
d646fc1f89
use sigalrm for printing progress bar
2022-11-28 00:14:05 +09:00
Ryo Nakamura
5188cf6df6
add ETA to progress print
2022-11-27 20:36:24 +09:00
Ryo Nakamura
130e735e65
skip sftp_free() inappropriately
2022-11-27 19:48:13 +09:00
Ryo Nakamura
db1431ed6a
only the last thread changes dst file permission
2022-11-27 00:06:39 +09:00
Ryo Nakamura
8cc964ca8a
fix duplicate error message on ssh auth failed.
...
and fix the final \n with -q
2022-11-26 17:34:24 +09:00
Ryo Nakamura
dca0241824
add O_TRUNC when the first open() for a file
2022-11-18 22:30:34 +09:00
Ryo Nakamura
f4d04b848e
don't stop on macos whem -m coremask is set
2022-11-18 22:24:46 +09:00
Ryo Nakamura
04ae5ee1dc
remove pr_warn debug
2022-11-18 21:52:58 +09:00
Ryo Nakamura
71efeaa4ba
fix type of id for sftp_async_write
2022-11-18 20:33:50 +09:00
Ryo Nakamura
5e7aa774ca
fix when copy multiple sources and various tiny fixes
...
* when copying multiple sources, target must be directory
* add multi-src copy test and parametrize src/dst prefixes
* cleanup REAMDE (s/sessions/connections/g)
* make error output in copy functions simple
2022-11-18 20:20:19 +09:00
Ryo Nakamura
b8d58b1fba
tiny fix
...
- set ssh nonblocking before closing sftp session
- fix pprint for core mask
2022-11-18 13:47:24 +09:00
Ryo Nakamura
5ede4dc122
fix async handling
2022-11-17 23:46:51 +09:00
Ryo Nakamura
2d66f4ca14
fix idx increment (typo) and async write improves copy speed!
2022-11-17 22:09:59 +09:00
Ryo Nakamura
d448f9eb8a
implement local-to-remote copy with async_write
2022-11-17 21:46:21 +09:00
Ryo Nakamura
41da0c5cfe
check invalid coremask
2022-11-16 01:57:27 +09:00
Ryo Nakamura
a69115a4dc
add -m coremask option
2022-11-15 19:57:53 +09:00
Ryo Nakamura
e9d5ceb462
add memory barrier to notify monitor thread of copy threads finished
2022-11-13 15:33:45 +09:00
Ryo Nakamura
81a7fbd2d8
add -a nr_ahead option
2022-11-13 15:31:12 +09:00
Ryo Nakamura
cfbbae860c
little trick to make progress bar stable
2022-11-12 17:45:08 +09:00
Ryo Nakamura
756e0759f9
fix buf size in remote to local copy.
...
Too large buffer size for sftp_async_read causes unfinished copy:
sftp_async_read returns 0 althrough data remains.
2022-11-12 17:30:51 +09:00
Ryo Nakamura
71d827d613
fix some thread handling
2022-11-12 16:11:20 +09:00
Ryo Nakamura
73e884f9c5
use sftp_async_read for remote to local copy
2022-11-12 15:30:01 +09:00
Ryo Nakamura
8eb9e69c1c
fix incorrect ret handling for read/write
2022-11-08 10:06:30 +00:00
