Release Notes

Flexify.IO

2.15.1

Bug fixes

FL-2570 Secret value cannot be retrieved from Azure Key Vault


2.15.0

New features

FL-599 Reading objects content from CDN

FL-2520 An option to skip/remove headers during migration

FL-2255 GetObjectAttributes support

Enhancements

FL-2545 Added all Akamai (Linode) regions

FL-1929 S3 version IDs returned by Flexify are now URL safe

FL-2530 Upload ID are URL-safe and compatible with Jclouds AWS2 signature calculation

FL-2529 Custom multipart limit can set to lower value for multipart migration in one part

FL-2366 Virtual endpoint settings show protocols (http, https, both) supported by particular S3 endpoint

FL-2494 Support for CopyObject and UploadPartCopy operations for Azure storage accounts with Entra ID authorization

FL-2406 New versioning scheme for flexify-api-python so that it can be installed via PIP

FL-2418 Not logging text files content to DEBUG engine logs

FL-2394 Migration log and reports on/off switch for individual users

FL-2502 Support for non-MD5 S3 checksum algorithms for proxy

Bug fixes

FL-1605 Deleted user is displayed at the list of impersonators

FL-2253 ListPart without object key returns incorrect status code and error message

FL-2351 Engine report cannot be process with error message: HTTP 400 Bad Request with JSON parse error: Unexpected character ('N' (code 78)) in numeric value.

FL-2386 False positive detection of unexpected objects order in the objects list after 403 error from destination storage on the ListObjects action

FL-2511 [Proxy] Incorrect handling of the remaining request body from a client after response is already sent

FL-2527 Engine crush after authentication error and multiple retries

FL-2512 CMD PROXY: Cloud storage secret key can't be specified as environment variable if engine is started from command line

FL-2552 [Proxy] Engine breaks Connection after DeleteObjects request to Azure with invalid VersionID format

FL-2484 Command-line proxy does not stop when delete is in progress

FL-2535 Migration always detects any Azure region as Private

FL-2547 Multipart object migration to Akamai (Linode) fails with the "No ETag in Complete Multipart Upload response" error


2.14.2

Bug fixes

FL-2543 Unable to migrate an object with Intelligent tiering with access tier of deep archive access


2.14.1

Enhancements

FL-2516 An option to allow selected users to migrate to Dropbox

Bug fixes

FL-2518 Error when migrating empty folder to Dropbox

FL-2519 Add fl-original-b2-file-id to Dropbox template to support migration from Backblaze B2


2.14.0

New features

FL-2482 Linking Azure to get the list of Storage Accounts

FL-2490 AWS China support

FL-2493 Support for response-* query parameters for GetObject and HeadObjects

Enhancements

FL-2488 Support new OVHcloud regions

FL-2495 More convenient sorting of endpoints for Virtual Endpoints

FL-2355 Improved flexify-engine command line interface

FL-2365 Command line engine: report errors to console

FL-2439 Improved Migration Wizard loading speed

FL-2472 GOOGLE cloud code is changed to GCP

FL-2476 Default Virtual Bucket Access Policy rule is be explicitly displayed in the list of rules

Bug fixes

FL-1542 Proxy: azure etag is returned w/o quotes

FL-2115 fl-original-md5 is stored to B2 even while contentMd5 is present

FL-2244 List parts response from proxy does not have "Initiator" value

FL-2278 Hanging connections on engine proxy

FL-2301 Proxy: 307 response from a cloud is not handled correctly

FL-2404 In multi-cloud configuration with Azure, UploadPartCopy proxy returns zero Etag

FL-2408 When migrating from B2 Native multipart files are not skipped per hash match

FL-2416 CompleteMultipartUpload error is not passed back to the client

FL-2444 SYSTEM ERROR - code 336130315: read: wrong version number

FL-2452 Source size is displayed even when prefix is defined

FL-2457 Dry run migration does not show total size of objects that would be migrated

FL-2460 Objects are not distributed across slots equally

FL-2463 ListObjectVersion does not return common prefixes when request contains delimiter

FL-2464 Starting migration again leads to Region unavailable error on the Migration Wizard page

FL-2465 Improved error handling on Wen Console

FL-2466 Not possible to specify preresigned URL in the objects list source

FL-2467 Not possible to specify over 4760 MiB multipart limit when migrating to B2

FL-2468 Multipart limit greather than 4294967295 bytes does not work correctly

FL-2469 Transparent background of data selection menu of Modified from/to fields

FL-2470 Modified from/to fields are shown even when objects list source is specified

FL-2471 Migrate button is inactive after error in Migration Wizard

FL-2473 SSO token refresh does not work when impersonating

FL-2478 Running dry run migration to Backblaze native with object greater than 1 GiB causes an error

FL-2479 Dry run migration from B2 Native - errors for large objects

FL-2480 Proxy returns 403 Forbidden for presigned put object request created by JavaScript SDK

FL-2481 Migration of multipart objects to Alibaba OSS fails

FL-2483 Management server runs more simultaneous migrations than allowed by the limits

FL-2485 Waiting migrations fails if no engine with enough free memory available at the moment of start

FL-2486 Engines limit for migration calculated for each of migration's mappings individually

FL-2491 Migration to B2 Native bucket with dot (.) fails

FL-2492 Dot encode sequence for buckets is not replaced by dot (.) in storage account buckets list

FL-2497 List Object Version return isTruncated true even there is no objects left when the selection policy set to fastest

FL-2498 Incorrect handling of the Connection: keep-alive header while getting bucket id from Backblaze B2 Native


2.13.0

New features

FL-2427 Support Device Code Flow for Microsoft Entra ID

Enhancements

FL-2376 An option to re-auth OAuth for a storage account

FL-2381 Cancel button on the Finish Auth dialog

FL-2426 Multipart upload and AWSv4 signature support for GCP

FL-2403 Updated Azure Blob API version to 2023-11-03

FL-2433 Show proper error texts for 400 errors

FL-2455 Support CompletedMultipartUpload tag in addition to CompleteMultipartUpload for compatibility with old versions of AWS SDK

Bug fixes

FL-2436 Fixed changing storage account setting when key is stored in vault

FL-2135 Expires metadata value is not written during migration to B2 via Native API

FL-2352 Engine continues to send ListObjectsV2 during migration even if it is not supported by cloud

FL-2364 Migration fails when migrating an object to Azure if user defined metadata key starts with a number.

FL-2370 ListObjectVersions does not include DeleteMarker in the response for Endpoint attached with AWS.

FL-2390 Can't add Azure storage accounts with Entra ID when impersonated

FL-2409 B2 to S3 migration skips objects due to has match even if object is different

FL-2420 Mapped storage class names are shown in statistics of Azure container

FL-2421 Engine crash after PutObject request with Content-Length: 0 and Expect: 100-Continue

FL-2432 Management server stops to assign tasks to engines when storage account with incorrect credentials from key vault is added.

FL-2435 CORS error when listing buckets by AWS Java Script SDK on Virtual endpoint enabled on Flexify CE

FL-2437 New destination container can't be created in Azure storage account during migration if SAS token is used as key

FL-2442 GET object response does not include "x-amz-tagging-count" if endpoint attached with AWS+AZURE and endpoint Settings "NEWEST"

FL-2445 Unable to change settings for Storage Accounts added with Entra ID (OAuth)

FL-2451 Engine crashes when processing multiple list object v2 request with option "start-after"

FL-2453 List Object v1 request with marker and delimiter returns an error.

FL-2454 ListObjectVersions request "Internal Server Error" when request parameter contains version-id-marker and key-marker


2.12.19

New features

FL-2356 Support for RBAC (AD) auth for Azure Storage Accounts

FL-2008 Azurite and Azure Stack support

FL-2172 Support for Azure Gov, China and Germany endpoints

FL-2350 GCore Storage support

FL-1186 CORS support on the Engine

FL-2354 Web UI option to change user limits

FL-2413 Storage classes / tier mapping between Azure and S3

Enhancements

FL-2268 Engine opens proxy port only after all proxy tasks are created

FL-2239 Different Web page titles

FL-2332 Informative error when storage info update for container in non-existent Azure storage fails

FL-2357 Dry run migration does not reads object content from source

FL-2359 PutObject supports authentication with query parameters

FL-2085 Allow migrations between different prefixes of the same bucket

FL-2250 Confirmation before stopping migration

FL-2263 AWS deployment template name moved from org to engine config

FL-2291 The limit and queue for the storage refresh tasks

FL-2294 Proxy prints generated keys to stdout

FL-2295 Support for x-amz-abort-date and x-amz-abort-rule-id for ListParts

FL-2299 Storing hashed engine passkeys in DB

FL-2300 Show all stats in tooltip popup on migration mapping and slot

FL-2327 Parsing of all S3 HTTP operations parameters

FL-2331 EU region for Impossible Cloud

FL-2333 New User-Agent value for Azure

FL-2346 Multiple DigitalOcean Droplet slugs for auto-deployment

FL-2382 Cancel during adding storage account also cancels the request to Azure

Bug fixes

FL-2251 List parts response from proxy ignores max-parts and part-number-marker values

FL-2262 Impossible to add endpoints again if previously endpoints were deleted with storage accounts attached

FL-2277 The value of secret key in endpoint card does not update after regeneration of keys

FL-2286 Proxy in multi-account configuration returns 404 Not Found for ListObjects in bucket that exists only in Azure

FL-2289 GetBucketVersioning returns Enabled status for multicloud configuration if bucket versioning is enabled only in one of clouds

FL-2290 ListObjectVersions returns multiple entries with IsLatest = True for the same key in multicloud configuration

FL-2292 Content-encoding metadata value is replaced by "aws-chunked" for chunked uploads via proxy

FL-2293 Engine crash on unexpected response from cloud

FL-2302 Storage info update always starts automatically for new bucket found during buckets list refresh

FL-2305 RefreshAwsRegionsJob and RefreshDigitalOceanRegionsJob failed: org.hibernate.LazyInitializationException: could not initialize proxy..

FL-2308 Deploying management server using ARM template and specifying upper-case character for `siteName` will result to not being able to login after creating account.

FL-2313 Multipart upload is not aborted when canceling migration

FL-2317 Null cost leads to wrong message in cost estimator

FL-2318 DELETE requests include a Content-Length header field

FL-2319 Engine can't decode List objects V2 response from cloud with Content-Encoding: gzip

FL-2320 No Microsoft SSO button in multi-user mode

FL-2321 Web console sends request with offset -1

FL-2328 Mismatch of md5 during migration to KMS-encrypted bucket

FL-2329 "Invalid Microsoft SSO auth state" error during attempt to login in more than one browser tab simultaneously

FL-2336 Proxy sends get-bucket-location request before put-object request for non-multiregional storage account

FL-2339 PUT object with invalid "contentMd5" value returns HTTP/1.1 500 Internal Server Error

FL-2341 Put object with SSE-C through Flexify endpoint with AZURE + AWS storage attached returns 502 Bad Gateway

FL-2342 Proxy: DeleteObject with incorrect versionId results in 500 Internal Server Error

FL-2345 Cost estimator is not appearing

FL-2348 Wrong 422 error translation

FL-2349 GetObjectTagging through Flexify endpoint with AZURE + AWS storage attached returns XML with no closing tag.

FL-2363 400 Bad Request: Mismatch Marker Protect for ListObjects with object key as marker value

FL-2374 Storage accounts stop updating after opening and closing storage account details dialog

FL-2391 Engine crash after ListObjectVersions and ListMultipartUploads request

FL-2398 Proxy: ListObjectVersions request with key-marker value causes 500 Internal server error

FL-2407 PutObjectTagging does not finish processing


2.12.18

New features

FL-2248 The ability to manually add bucket name to existing storage account

FL-2273 Engine warm up and warm down lifecycle stages

Enhancements

FL-2240 Added support for DigitalOcean Bangalore

FL-2246 Added API to search endpoints by auth_identity.

FL-2133 Improved migration wizard page load time

FL-2237 Admins impersonating as users now can do operations only allowed for admins

FL-2247 Logging impersonator name along with user name

FL-2275 Web UI showing secret key source/storage

FL-2078 Parallel tasks creation on engine to speed up warming up time

FL-2227 Clear Microsoft SSO error is not clear When using http

FL-2238 Reload web console when its build less than management server build number

FL-2178 Sending error response without waiting for request body to finish

FL-2249 Not showing balance warning for accounts on invoice billing

FL-2269 Allow identifying customer by INFO engine logs

FL-2276 "About the system" moved to the system tab

Bug fixes

FL-2114 CMD PROXY: skewed output when run under docker

FL-2218 Wrong last modified date when migrating from Backblaze B2

FL-2231 Proxy: multi-cloud delete object hangs

FL-2232 Incorrect text in engine deployment dialog

FL-2234 Engines may crush when proxy receives ListParts operation

FL-2235 Listing parts of just created empty multi-part upload returns 404 not found instead of empty part list

FL-2236 "Bad HTTP date format" error during migration of restored S3 objects

FL-2242 Engine requests region for DigitalOcean bucket

FL-2243 After SSO token expiration, login page does not redirect to previously open tab of Flexify management console

FL-2252 std::logic_error exception when working with proxy

FL-2258 Modified to date is not shown on migration card

FL-2260 Objects can't be uploaded to Azure via proxy if STANDARD storage class is explicitly specified by client.

FL-2265 400 Bad request when uploading to AWS S3 via proxy using Cyberduck client with direct connection to engine

FL-2266 Too many connection in CLOSE-WAIT for DeleteObject

FL-2270 403 Forbidden response from AWS S3 when sending Put Object with object tags and x-amz-content-sha256: STREAMING-AWS4-HMAC-SHA256-PAYLOAD

FL-2272 400 Forbidden response from AWS S3 when using Put Object with 0 bytes and x-amz-content-sha256: STREAMING-AWS4-HMAC-SHA256-PAYLOAD

FL-2279 Engine may crash if Create Multipart Upload is sent via proxy to GCP storage

FL-2280 Engine may crash if ListObjectVersions is sent via proxy to GCP and Amazon S3

FL-2281 Engine breaks connection with client if ListObjectVersions is sent via proxy to GCP

FL-2282 403 Forbidden response if sending ListMultipartUploads to GCP via proxy

FL-2284 Engine may crash if ListBuckets request have 'uploads' or 'versions' parameter.

FL-2283 Cyberduck can't list bucket content in DO after cancellation of Multipart Upload

FL-2287 S3 Browser receives "AWS2 signature does not match" error for attempt to delete multiple objects at once.

FL-2288 Bucket name is not forwarded by proxy to B2 S3 Compatible storage in GetBucketVersioning request


2.12.17

New features

FL-2134 Storing storage account key in Azure Key Vault

FL-2222 Storing virtual endpoint key in Azure Key Vault

FL-2215 Support automatic Azure Identity on Management Server

FL-2214 lastModifiedTo filter in migration

FL-2103 Support for GetBlockList operation when proxying to Azure

Enhancements

FL-2224 First user now can sign up with SSO

FL-2226 Microsoft SSO without Management Server having internet connection

FL-2186 Restore object status is now reported in HeadObject response proxied from Azure

FL-2119 Made more clear that Objects restored from Glacier are not migrated

FL-2219 Warning in UI if migration report upload fails

FL-2206 Management server Azure managed identity configuration moved to organization configuration

FL-2193 Search and partial download in the list of users

FL-2208 Log checksum into INFO log

Bug fixes

FL-2202 'The operation is not valid for the object's storage class' error in migration log

FL-2213 Using uppercase Etags for Alibaba

FL-2223 "invalid constant string" error in migration log when migration stopped manually

FL-2228 Web console redirects to http when run behind proxy that terminates SSL


2.12.16

New features

FL-2204 Added Microsoft account option to Set Password dialog for partner user

Enhancements

FL-2127 Showing the number of endpoints and virtual buckets in engine statistics

FL-2191 Pass redirectUrl via Microsoft SSO auth

Bug fixes

FL-2139 Cancel does not work when adding storage account

FL-2170 List of users does not fit the screen

FL-2196 Multiple engine restarts when listing of content in Dropbox

FL-2197 Engine dies: limits the number of elements in an IN predicate to 2100 entries

FL-2198 Thread race when writing to engine log

FL-2199 Engine does not mark finish storage info tasks as finished

FL-2201 Migration slot hanged on the engine

FL-2203 Engine does not send reports to management server for 15-20 minutes if many storage info tasks finished simultaneously


2.12.15

New features

FL-2189 Single sign-on with Microsoft

FL-2184 DEB package for Engine

Enhancements

FL-2187 Support for DigitalOcean Spaces in Sydney

FL-2182 Removed the limits for the number of user metadata headers during migrations to B2 via Native API

FL-2111 Allow changing providers.json location

FL-2112 Automatically find certificates file

FL-2113 Rename "Downloaded to storage" to "Downloaded from storage"

Bug fixes

FL-2062 Migration fails because no space left on VM

FL-2123 Confusing logging on engine when not possible to open endpoint port

FL-2167 Error in prod log: "Cannot send email to: **** java.lang.NullPointerException"

FL-2180 fl-original-etag is erroneously set when it can be calculated from md5

FL-2181 Multipart limit and Part size values are allowed to be selected in Web-UI for migration to GCP

FL-2183 Proxy does not return Flexify-specific metadata that was set during migration by Flexify engine

FL-2188 Multi-regional storage accounts are not considered as multi-regional


2.12.14

Bug fixes

FL-2028 Copy object does not change storage class when x-amz-metadata-directive is COPY

FL-2141 100% CPU, TCP: out of memory -- consider tuning tcp_mem

FL-2159 Engine crush during migration: is_closing_session(): no DBUS_SESSION_BUS_ADDRESS in environment

FL-2162 Engine is case sensitive to header names

FL-2171 "Connection refused" is not retried

FL-2173 Migration of multipart objects from Dropbox fails with "incorrect part range" error

FL-2169 Unable to impersonate to a user account: String or binary data would be truncated

FL-2176 Log table is not fitting into the dialog box

FL-2168 Management Server DB used space is growing


2.12.13

New features

FL-2157 Added a button to remove all dead engines in one click

Enhancements

FL-2131 Log request id from cloud to INFO log

FL-2147 Include large fields only to final report for storage info tasks

FL-2148 Write connection stats to log when sending data as well

FL-2152 On engine registration, run state update only if engine is configured for forwarding

Bug fixes

FL-2110 Map AWS EU region on engine

FL-2125 Management server log: WARN | forwarding task XXX is already STOPPED and should not be included in engine report

FL-2140 Engine logs are uploaded to Azure without prefixes

FL-2141 100% CPU, TCP: out of memory -- consider tuning tcp_mem

FL-2149 Slow processing of engine task reports

FL-2160 Engine does not report destActiveMarker

FL-2163 Dead engines are not dying


2.12.12

New features

FL-2072 Virtual Bucket Access Policy

FL-2099 Support for object tagging for proxy

FL-2020 An option to set X-Bz-Custom-Upload-Timestamp when migrating to B2

FL-2056 An option to collapse and search endpoints in UI

FL-2060 Search in the list for engines

FL-2057 API and UI to revoke tokens

FL-2073 API to get status of specific engine

FL-2077 Allow to define endpoint name

FL-2069 Storj support

FL-2089 Allow adding multiple buckets for the same storage account in Web UI

FL-2116 Allow admins to manage engine registration keys

Enhancements

FL-800 Removed deadlock during storage update

FL-1904 has is used instead of verbStamp when assigning tasks to engines

FL-1918 log2 is used for charts instead of log10

FL-1947 ETag is checked as checksum for multipart upload

FL-2017 Error messages from engines are distinct from errors passed from a cloud

FL-2025 Log x-forwarded-for to log

FL-2042 Unicode code points U+FDD0 and U+FDDD are escaped for Azure

FL-2049 Engine returns "400 Bad Request" instead of "500 Internal Server Error" when unable to parse S3 reqeust

FL-2053 Support modern regex in object filter

FL-2055 Compatibility with Arkime

FL-2071 Got rid of transparent mode

FL-2080 Made POLLING_INTERVAL for web console configurable

FL-2130 Added information to INFO log about bytes processed during long request

FL-2132 User log entries are saved to Azure log after response returned to the caller

FL-2036 Write date in ISO format to migration report

FL-2046 Added ability to define log level for engine sync only

FL-2081 Support for RedHat 8

Bug fixes

FL-2068 Fixed virtual scroll for migrations

FL-2076 Not able to download Azure regions makes it impossible to add storage account

FL-2090 Range header is ignored in HEAD requests

FL-2137 Engines in New state show outdated statistics

FL-1928 deleteMarker=null is returned when delete object is proxied to Azure with versioning enabled

FL-2021 Content length changed does not result in object being skipped.

FL-2023 "connect failed with system_error (socket/connect: Protocol not available)" is not retried

FL-2024 Error if object key matches source prefix during migration

FL-2030 Task hash changes when management server restarts

FL-2032 Task with the same id is created on engine twice: statistics lost (server logic error)

FL-2037 Multipart object is missing from report of dry run migration

FL-2039 Invalid report CSV when ETag contains quotes

FL-2052 Prefix should be encoded for AZURE and B2

FL-2059 Comparison method should be N/A for overwrite

FL-2065 List objects via proxy to Azure returns empty list

FL-2082 Endpoint tasks are not assigned to engines under hight load

FL-2093 Problem with unread body in 100-continue request if final result is ready after headers are read.

FL-2095 Conflicts between virtual endpoints

FL-2096 Signature doesn't match when uploading a part using Presigned URL

FL-2104 Changing storages order in UI is not reflected in Tasks config for engines

FL-2124 Only virtual buckets with public access should be checked for duplicate names

FL-2146 Task creation exception: access key is already used by another forwarding task

FL-2128 Wrong endpoint state and endpoint does not recover even if error in configuration is fixed

FL-2138 Proxy memory leak due ta hanged connections


2.12.11

New features

FL-2018 List comparison for AWS, Azure, B2, GCP, DO, Wasabi

FL-1422 Support Azure Shared Signature (SAS)

FL-1951 Support UploadPartCopy

FL-2011 New nodelete option for virtual endpoint

Enhancements

FL-1896 Web console without internet connect

FL-2005 Support maxIncomingConnections on the management server

FL-1924 Engine returns x-amz-request-id in addition x-amz-id2

FL-1912 Rename Endpoint to Endpoints

FL-1987 Escape more Unicode code points for Azure

FL-1984 GetLocation returns engine region instead of flexify-io

Bug fixes

FL-1921 abort-multipart-upload could be sent after complete-multipart-upload if migration is cancelled

FL-1953 Incomplete multipart upload is not aborted if migration is stopped

FL-1938 Engine crashes if it does not understand response from Azure

FL-1939 Engine returns unpredictable result if connection is kept after error

FL-1949 ContainerNotFound is returned as NoSuchKey

FL-1960 Proxy: transparent mode (noconv) break connection too early if connection: close header present

FL-1964 The number of failed objects is not properly formatted under Slots

FL-1965 Proxy returns incorrect values for VersionId and ETag in CompleteMultipartUpload response for Azure with versioning enabled

FL-1968 Proxy: if object delete fails from one cloud, proxy should return failure

FL-1979 Dropbox refresh errors in production log

FL-1981 Proxy + Azure: 500 error (Incorrect UID) is returned for CopyObject request with specified VersionId

FL-1982 Proxy ignores Encoded="true" for object key from Azure

FL-1997 Proxy keeps client connections when endpoint is disabled

FL-1893 Info in UI log about multipart disappeared objects is duplicated.

FL-1894 Disappeared multipart object should not be included to failed statistic.


2.12.10

New features

FL-785 Automatic restore from Amazon Glacier

FL-1794 Priority selection when reading data from a cloud

FL-1956 Support for RestoreObject operation in proxy

FL-1800 Support for objects versioning in proxy

FL-1903 Synology C2 support

Enhancements

FL-1834 The ability to specify bucket name when adding storage account

FL-1966 CORS is enabled byd default

FL-1515 Instructions when adding GCP account

FL-1880 Retries when reading list from a file

Bug fixes

FL-1925 Support fetch-owner=false for compatibility with AWS SDK for Java

FL-1936 AWS SDK for Java fails with error when downloading multipart objects from Azure

FL-1970 Proxy: list-object-v2 with encoding-type=url does not encode returned values

FL-1905 Engine does not report migration progress if high number of streams is used

FL-1886 Engine Out of Memory restart due to large number of migration streams and/or retries

FL-1876 Engine fails to verify SSL certificate when there is port in URL


2.12.8

New features

FL-1824 Engines generate migration report

FL-881 Optimize incremental migration and cleanup to request two lists and compare them

FL-1636 Filebase support

FL-1775 Support Wasabi's us-west-1 and ap-northeast-2 region

FL-1821 Support Wasabi's eu-west-2 region

FL-1625 Exporting Dropbox non-downloadable files

FL-1551 Change the maximum value for Multipart limit for Azure

Enhancements

FL-1732 Automatic loading of more migrations when scrolling

FL-1767 Allow Flexify to connect to Flexify (but prevent cycles)

FL-1774 Rename Mail.ru to VK

FL-1755 Gray our dialog when refresh is pressed before data arrives

FL-1748 Warning message in case of removing bucket

FL-1691 Balance warning is not displayed for accounts with no initial balance

FL-1631 Do not show "remaining" for migrations without progress

Bug fixes

FL-1819 Update to Spring Boot version that brings log4j 2.17.0 or higher

FL-1815 Endless storage info update on Exoscale

FL-1812 Unable to list over 2000 objects in Dropbox

FL-1809 Errors during migration and statistics update for Airee cloud storage

FL-1802 Migration fails with "Bad file descriptor" message

FL-1788 Memory leak on Engine machine

FL-1771 Engine restarted during migration

FL-1772 "XML root doesn't match" error when migrating to Wasabi

FL-1770 Migration fails with processing EXCEPTION: std::bad_alloc

FL-1768 It's possible to edit text in a hidden field after copy icon

FL-1764 Lost connection to engines when canceling migration

FL-1763 Engine restarts during storage statistics refresh

FL-1760 Compose installations script fails to run on CentOS


2.12.0

Features

FL-1166 Automatic engine deployment

FL-1193 Migration dry run

FL-1396 Expose engine config, distributor and organizations via REST API

Enhancements

FL-1396 Expose engine config, distributor and organizations via REST API

FL-1424 Rename Microsoft Azure to Azure

FL-832 Use proper IEC measures

FL-875 Deprecate support for path style addressing along with AWS

FL-976 Show the number of buckets in each Storage Account

FL-1414 The ability to define/change organization for a user

FL-992 Improve error message when bucket name is already taken

FL-1015 Show mapping progress (percentage) in waiting state

FL-1273 Add ability to cancel add storage

FL-1330 Download and save DigitalOcean regions

FL-1364 Show deployment mode in the migration settings

FL-1378 Change error message when no auto-deploy metric is not found

FL-1381 Show exact cost in the costs table

FL-1387 Compatibility with OVH Cloud

Bug Fixes

FL-893 Incremental migration with SOURCE always copies objects >5 GB

FL-949 No info in migration log about died engine

FL-1073 Wrong host name for B2 in log

FL-1138 The error when migration starts to Alibaba Cloud OSS

FL-1269 Migration error "Host not found" is not retried

FL-1271 Retry Bad Request with RequestTimeout timeout code

FL-1283 Fix error message when PROBE returns a error

FL-1286 Don't show "null" in log message for clouds without regions

FL-1296 CE: specifying a custom container port does not work

FL-1298 Migration in 1000 streams waits in "waiting" state

FL-1319 Refresh failed due to fatal error: Invalid integer: non-digit char

FL-1333 The body of 401 "Unauthorized" response from B2 is not logged to INFO log

FL-1337 Migration "start again" keeps non-existing location

FL-1338 Automatically load regions in Add Engine dialog

FL-1339 Fix distance between elements

FL-1342 Put Block request failed: 400 The specified blob or block content is invalid during migrating 227.9 MB file to Azure

FL-1343 It's possible to specify 0 in "Part size" field

FL-1344 Texts do not fit in migration task info

FL-1349 Sometimes cost estimation during "start again" does not account for cloud/region

FL-1352 "Migration ended" is not logged

FL-1354 Traffic estimate does not work when new engines cloud is specified, but region is not

FL-1357 Single-VM / CE shows cost estimate as $0.00 instead of traffic

FL-1360 It's possible to specify the number of engines > conf_max_auto_deploy_engines_count

FL-1361 Internal server error when creating migration in case of disabled billing

FL-1362 Cost estimate is called two times

FL-1363 "Unable to find price for task" error in the log

FL-1366 Your socket connection to the server was not read from or written to within the timeout period

FL-1369 Engine fails to register with could not execute statement exception

FL-1372 Two slots are assigned to the same engine

FL-1373 Updating "region for new buckets" does not update estimate

FL-1374 Migration fatal error: 4 objects in 3 pages are not marked as done

FL-1375 Error "Part number must be in the range 1 10000" when migrating to B2

FL-1376 Failed due to fatal error: More objects finished than in the page

FL-1382 Stopping migration with unassigned slots results in the slots assigned

FL-1386 Azure ranges provider returns wrong region names

FL-1388 The list of regions is not filtered

FL-1393 Wrong engine certificates does not result in endpoint error

FL-1394 403 Forbidden when trying to access bucket with DNS name by IP

FL-1395 Wrong set password link when containerized web app is used

FL-1398 It's possible to specify new bucket name with space in the beginning which results in the malformed HTTP version error

FL-1399 Google cloud region is cleared when migration starts

FL-1400 When signing out from impersonation, the user also signs out

FL-1403 Don't perform copy retries in case of 503 "Slow Down"

FL-1405 GCP bucket names with underscore result in SSL error

FL-1409 Message about unique buckets should only be shown when creating a bucket.

FL-1412 Wrong migration part size is selected

FL-1413 Reduce connection timeout to 30 seconds

FL-1417 Stopping multi-mapping migration reassigns all slots

FL-1418 "source object disappeared" is counted as failed

FL-1419 Migration will not be assigned to engine XXX because it does not have enough available RAM.

FL-1420 Listing of B2 is done 100 objects per page (instead of 10000)

FL-1421 Sometimes objects are counted two times

FL-1437 10GB limit is not applied for automatic deployment

FL-1446 Cost estimate is not updated after changing Run on to Auto during re-migration.

FL-1448 Spinner is freezed when clicking Ok on edit profile with no changes

FL-1449 Listing of Alibaba objects results in error

FL-1466 Large files w/o MD5 are not skipped when migrating from Azure

FL-1468 Files with equal md5 and renamed is not skipped

FL-1470 Accounts with $0.00 are suspended


2.8.1

Fixes

FL-817 Vulnerability in Java API

FL-820 Automatic storage refresh does not work on prod

FL-821 Manual refresh of invalid account should not update automatic refresh interval.

FL-822 Deleting user from prod took over an hour

FL-823 Dell EMC is missing in providers list

FL-824 Custom EMC ECS is not possible to connect without SSL

FL-827 Scheduled storage refresh fails on prod at storage 368 or 377 (Samsung WSS provider)

FL-828 Pspace is not in the list of providers for on-premise installation

FL-830 Internal error in console when selecting a bucket for migration in single-vm install

FL-831 Mapping status is incorrectly shown as waiting when all slots in facts succeeded

FL-818 Proxy should return 503 when cloud breaks connection

FL-819 "Connection is not available, request timed out after 30000ms" in production logs after upgrade


2.8.0

Features

FL-768 On-premise deployment

FL-71 Support for 3rd-party S3 storage (Minio, EMC ECS and other)

FL-724 Support multipart upload to two or more storages

FL-704 Send email notifications when migration completes/fails

FL-528 Automated engine deployment for Azure

FL-547 Tag Azure Traffic

FL-779 Include region in storage stat

FL-796 DigitalOcean FRA1 Region

Fixes

FL-711 Storage refresh should wait for timeout even if refresh attempt failed

FL-734 Error message in upper left corner - red rectangle

FL-736 IllegalArgumentException: id to load is required for loading in production server log

FL-753 Error refreshig storage account io.flexify.rest.exception.FlexifyException: OPERATION_NOT_PERMITTED.BILLING_ACCOUNT_SUSPENDED

FL-756 Refresh icon sometimes continue to rotate when storage account refresh is already done

FL-757 PSPACE: S3 operation 'Head bucket daria-test-dif-symbol' failed. SDK retruned: Unable to execute HTTP request: daria-test-dif-symbol.vpn.pspace.com

FL-761 Engine does reports NULL active_marker when first start_from page is not completed yet

FL-763 ERROR in production logs: UnexpectedRollbackException for refreshStoragesStatJob

FL-765 Usability: expand storage account in a tree when user clicks on it

FL-766 Subfolder selection is not intuitive

FL-770 Storage refresh does not fail when engine unregisters

FL-772 "Starting automatic storage statistics refresh" should not be in a log if previous refresh did not finished

FL-773 Implement a user-friendly error message for the OTHER

FL-778 Specify reason in user's log when refresh fails

FL-787 CompleteMultipartUpload always fails on one engine

FL-801 Core dump when requesting list of objects and end of file is encountered

FL-802 The field " Subfolder/match pattern" with * overlaps the information window

FL-803 Increase the size of tooltips for fields when starting a new migration

FL-804 The engine stops responding when you start migrations with a large number of small files.

FL-806 Add clean up tasks to active tasks stat at engines list

FL-807 The restart of the migration in the process of clean up not going to happen in the fall of the engine.

FL-810 It took almost a minute for management server to assign 10 forwarding task to a new engine

FL-697 Web GUI polls storage accounts even when no storage accounts are displayed

FL-771 Deny requests with Agent: Flexify.IO

FL-776 Add etag_uppercase option

FL-777 Accept <Encoding-Type> in addition to <EncodingType>

FL-780 Order storages by name (if defined) in a list of storages

FL-786 Find Azure regions for Azure accounts

FL-788 Deploy Azure containers in different container groups

FL-795 GDPR