Storware Backup & Recovery
    • Sharepoint site backup error

      Microsoft 365 3 8 3.4k

      Hi Everyone,

      I've setup a Job that backups some Sharepoint sites, the backup worked fine for a while but now it hangs on a specific site, if I delete the backup of this specific site the next 2-3 runs works fine, after that I got this error:

      [2024-01-12 12:20:21.104] ERROR [pool-5-thread-274] ExportTask.run:134 
      [2d9a0268-6e86-45a6-83c5-160a24d0a957] Backup task failed: com.sun.jersey.api.client.ClientHandlerException: java.net.ConnectException: Connection refused (Connection refused) at com.sun.jersey.client.urlconnection.URLConnectionClientHandler.handle(URLConnectionClientHandler.java:155) ~[engine.jar:?]
      

      I've already rebooted the VM and updated it to the latest Storware 5.2 (5.2.0-78).

      Any suggestion?

      Thanks and regards,
      Cristian

    • Hi @Cristian-Eglue
      Please send me full logs so i can investigate it further.
      Best regards
      Jan Leszczyński

    • Hi @Jan-Leszczyński

      Here are:

      [2024-02-19 22:08:18.909] INFO [pool-5-thread-497] ExportTask.run:114 
      [30317a65-acf7-483d-9b31-fb0360b77028] Starting export of VM/App/Storage/Cloud: SITE Sales from MICROSOFT365 (MICROSOFT365)...
      
      [2024-02-19 22:08:18.909] INFO [pool-5-thread-497] BackupProviderUtil.testConnection:205 
      [30317a65-acf7-483d-9b31-fb0360b77028] Testing connection with backup provider: File System for Cloud
      
      [2024-02-19 22:08:18.909] INFO [pool-5-thread-497] FileUtil.removeLocalTestFiles:617 
      [30317a65-acf7-483d-9b31-fb0360b77028] Cleaning up after Connectivity Test
      
      [2024-02-19 22:08:18.933] WARN [pool-5-thread-497] ExportIncremental.isIncrementalExportPossible:112 
      [30317a65-acf7-483d-9b31-fb0360b77028] Reasons why incremental is not possible of the VM (Sales - f7bdd559-9694-41eb-8993-91eb0f788f41): Warning: Required backups not found or were not successful., Warning: Incremental snapshot is not available.
      
      [2024-02-19 22:08:18.933] WARN [pool-5-thread-497] ExportTask.pickApplicableBackupType:243 
      [30317a65-acf7-483d-9b31-fb0360b77028] Incremental backup for MICROSOFT365 is not available at this time.
      
      [2024-02-19 22:08:18.953] INFO [pool-5-thread-497] ExportFull.export:30 
      [30317a65-acf7-483d-9b31-fb0360b77028] Performing full backup
      
      [2024-02-19 22:08:19.053] INFO [pool-5-thread-497] BackupProvider.restore:203 
      [30317a65-acf7-483d-9b31-fb0360b77028] Restoring file [metadata.db.gz] to [/vprotect_data/cloud-f7bdd559-9694-41eb-8993-91eb0f788f41/db/f7bdd559-9694-41eb-8993-91eb0f788f41/SHAREPOINT/metadata.db.gz]
      
      [2024-02-19 22:08:19.054] INFO [pool-5-thread-497] DataWriterUtil.isSparsifyPossibleOnFilesystem:55 
      [30317a65-acf7-483d-9b31-fb0360b77028] Checking if it's possible to create a sparsified file /vprotect_data/cloud-f7bdd559-9694-41eb-8993-91eb0f788f41/db/f7bdd559-9694-41eb-8993-91eb0f788f41/SHAREPOINT/metadata.db.gz.test
      
      [2024-02-19 22:08:19.291] INFO [pool-5-thread-497] DataWriter.create:27 
      [30317a65-acf7-483d-9b31-fb0360b77028] Sparsify is possible. Trying to skip empty blocks of file
      
      [2024-02-19 22:08:19.419] INFO [pool-5-thread-497] BackupProvider.restore:203 
      [30317a65-acf7-483d-9b31-fb0360b77028] Restoring file [metadata.db.gz] to [/vprotect_data/cloud-f7bdd559-9694-41eb-8993-91eb0f788f41/db/metadata.db.gz]
      
      [2024-02-19 22:08:19.420] INFO [pool-5-thread-497] DataWriterUtil.isSparsifyPossibleOnFilesystem:55 
      [30317a65-acf7-483d-9b31-fb0360b77028] Checking if it's possible to create a sparsified file /vprotect_data/cloud-f7bdd559-9694-41eb-8993-91eb0f788f41/db/metadata.db.gz.test
      
      [2024-02-19 22:08:19.442] INFO [pool-5-thread-497] DataWriter.create:27 
      [30317a65-acf7-483d-9b31-fb0360b77028] Sparsify is possible. Trying to skip empty blocks of file
      
      [2024-02-19 22:08:19.458] INFO [pool-5-thread-497] CompressorFactory.create:15 
      [30317a65-acf7-483d-9b31-fb0360b77028] Compression type: GZIP
      
      [2024-02-19 22:08:19.617] INFO [pool-5-thread-497] CompressorFactory.create:15 
      [30317a65-acf7-483d-9b31-fb0360b77028] Compression type: GZIP
      
      [2024-02-20 09:01:02.156] ERROR [pool-5-thread-497] Microsoft365CloudService.waitAndUpdateProgress:644 
      [30317a65-acf7-483d-9b31-fb0360b77028] java.net.ConnectException: Connection refused (Connection refused)
      
      com.sun.jersey.api.client.ClientHandlerException: java.net.ConnectException: Connection refused (Connection refused)
      	at com.sun.jersey.client.urlconnection.URLConnectionClientHandler.handle(URLConnectionClientHandler.java:155) ~[engine.jar:?]
      	at com.sun.jersey.api.client.filter.GZIPContentEncodingFilter.handle(GZIPContentEncodingFilter.java:123) ~[engine.jar:?]
      	at com.sun.jersey.api.client.Client.handle(Client.java:652) ~[engine.jar:?]
      	at com.sun.jersey.api.client.WebResource.handle(WebResource.java:682) ~[engine.jar:?]
      	at com.sun.jersey.api.client.WebResource.access$200(WebResource.java:74) ~[engine.jar:?]
      	at com.sun.jersey.api.client.WebResource$Builder.put(WebResource.java:539) ~[engine.jar:?]
      	at io.swagger.client.ApiClient.getAPIResponse(ApiClient.java:647) ~[engine.jar:?]
      	at io.swagger.client.ApiClient.invokeAPI(ApiClient.java:680) ~[engine.jar:?]
      	at io.swagger.client.api.TaskControllerApi.updateCloudTaskProgress(TaskControllerApi.java:1515) ~[engine.jar:?]
      	at eu.storware.vprotect.engine.api.controller.TaskController.updateCloudProgressAndTransferSize(TaskController.java:256) ~[engine.jar:?]
      	at eu.storware.vprotect.engine.cloudservice.microsoft365.Microsoft365CloudService.updateTaskProgress(Microsoft365CloudService.java:692) ~[engine.jar:?]
      	at eu.storware.vprotect.engine.cloudservice.microsoft365.Microsoft365CloudService.waitAndUpdateProgress(Microsoft365CloudService.java:641) [engine.jar:?]
      	at eu.storware.vprotect.engine.cloudservice.microsoft365.Microsoft365CloudService.exportFull(Microsoft365CloudService.java:471) [engine.jar:?]
      	at eu.storware.vprotect.engine.cloudservice.microsoft365.Microsoft365CloudService.exportFull(Microsoft365CloudService.java:97) [engine.jar:?]
      	at eu.storware.vprotect.engine.task.export.strategy.ExportFull.export(ExportFull.java:55) [engine.jar:?]
      	at eu.storware.vprotect.engine.task.ExportTask.exportBackup(ExportTask.java:215) [engine.jar:?]
      	at eu.storware.vprotect.engine.task.ExportTask.run(ExportTask.java:127) [engine.jar:?]
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
      	at java.lang.Thread.run(Thread.java:829) [?:?]
      Caused by: java.net.ConnectException: Connection refused (Connection refused)
      	at java.net.PlainSocketImpl.socketConnect(Native Method) ~[?:?]
      	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:412) ~[?:?]
      	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:255) ~[?:?]
      	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:237) ~[?:?]
      	at java.net.Socket.connect(Socket.java:609) ~[?:?]
      	at java.net.Socket.connect(Socket.java:558) ~[?:?]
      	at sun.net.NetworkClient.doConnect(NetworkClient.java:182) ~[?:?]
      	at sun.net.www.http.HttpClient.openServer(HttpClient.java:507) ~[?:?]
      	at sun.net.www.http.HttpClient.openServer(HttpClient.java:602) ~[?:?]
      	at sun.net.www.http.HttpClient.pa**eHTTPHeader(HttpClient.java:892) ~[?:?]
      	at sun.net.www.http.HttpClient.pa**eHTTP(HttpClient.java:722) ~[?:?]
      	at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1615) ~[?:?]
      	at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1520) ~[?:?]
      	at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:527) ~[?:?]
      	at com.sun.jersey.client.urlconnection.URLConnectionClientHandler._invoke(URLConnectionClientHandler.java:253) ~[engine.jar:?]
      	at com.sun.jersey.client.urlconnection.URLConnectionClientHandler.handle(URLConnectionClientHandler.java:153) ~[engine.jar:?]
      	... 19 more
      [2024-02-20 09:01:07.010] INFO [pool-5-thread-497] Microsoft365CloudService.waitAndUpdateProgress:650 
      [30317a65-acf7-483d-9b31-fb0360b77028] Task was cancelled or failed.
      
      [2024-02-20 09:01:27.839] ERROR [pool-5-thread-497] ExportTask.run:134 
      [30317a65-acf7-483d-9b31-fb0360b77028] Backup task failed: 
      
      com.sun.jersey.api.client.ClientHandlerException: java.net.ConnectException: Connection refused (Connection refused)
      	at com.sun.jersey.client.urlconnection.URLConnectionClientHandler.handle(URLConnectionClientHandler.java:155) ~[engine.jar:?]
      	at com.sun.jersey.api.client.filter.GZIPContentEncodingFilter.handle(GZIPContentEncodingFilter.java:123) ~[engine.jar:?]
      	at com.sun.jersey.api.client.Client.handle(Client.java:652) ~[engine.jar:?]
      	at com.sun.jersey.api.client.WebResource.handle(WebResource.java:682) ~[engine.jar:?]
      	at com.sun.jersey.api.client.WebResource.access$200(WebResource.java:74) ~[engine.jar:?]
      	at com.sun.jersey.api.client.WebResource$Builder.post(WebResource.java:570) ~[engine.jar:?]
      	at io.swagger.client.ApiClient.getAPIResponse(ApiClient.java:645) ~[engine.jar:?]
      	at io.swagger.client.ApiClient.invokeAPI(ApiClient.java:680) ~[engine.jar:?]
      	at io.swagger.client.api.BackupFilesControllerApi.createBackupFile(BackupFilesControllerApi.java:83) ~[engine.jar:?]
      	at eu.storware.vprotect.engine.api.controller.BackupFileController.create(BackupFileController.java:144) ~[engine.jar:?]
      	at java.util.ArrayList.forEach(ArrayList.java:1541) ~[?:?]
      	at eu.storware.vprotect.engine.cloudservice.microsoft365.Microsoft365CloudService.updateEffectiveBackupSizeForCancelledTask(Microsoft365CloudService.java:679) ~[engine.jar:?]
      	at eu.storware.vprotect.engine.cloudservice.microsoft365.Microsoft365CloudService.exportFull(Microsoft365CloudService.java:512) ~[engine.jar:?]
      	at eu.storware.vprotect.engine.cloudservice.microsoft365.Microsoft365CloudService.exportFull(Microsoft365CloudService.java:97) ~[engine.jar:?]
      	at eu.storware.vprotect.engine.task.export.strategy.ExportFull.export(ExportFull.java:55) ~[engine.jar:?]
      	at eu.storware.vprotect.engine.task.ExportTask.exportBackup(ExportTask.java:215) ~[engine.jar:?]
      	at eu.storware.vprotect.engine.task.ExportTask.run(ExportTask.java:127) [engine.jar:?]
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
      	at java.lang.Thread.run(Thread.java:829) [?:?]
      Caused by: java.net.ConnectException: Connection refused (Connection refused)
      	at java.net.PlainSocketImpl.socketConnect(Native Method) ~[?:?]
      	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:412) ~[?:?]
      	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:255) ~[?:?]
      	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:237) ~[?:?]
      	at java.net.Socket.connect(Socket.java:609) ~[?:?]
      	at java.net.Socket.connect(Socket.java:558) ~[?:?]
      	at sun.net.NetworkClient.doConnect(NetworkClient.java:182) ~[?:?]
      	at sun.net.www.http.HttpClient.openServer(HttpClient.java:507) ~[?:?]
      	at sun.net.www.http.HttpClient.openServer(HttpClient.java:602) ~[?:?]
      	at sun.net.www.http.HttpClient.<init>(HttpClient.java:275) ~[?:?]
      	at sun.net.www.http.HttpClient.New(HttpClient.java:374) ~[?:?]
      	at sun.net.www.http.HttpClient.New(HttpClient.java:395) ~[?:?]
      	at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1253) ~[?:?]
      	at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1187) ~[?:?]
      	at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1081) ~[?:?]
      	at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:1015) ~[?:?]
      	at sun.net.www.protocol.http.HttpURLConnection.getOutputStream0(HttpURLConnection.java:1367) ~[?:?]
      	at sun.net.www.protocol.http.HttpURLConnection.getOutputStream(HttpURLConnection.java:1342) ~[?:?]
      	at com.sun.jersey.client.urlconnection.URLConnectionClientHandler$1$1.getOutputStream(URLConnectionClientHandler.java:238) ~[engine.jar:?]
      	at com.sun.jersey.api.client.CommittingOutputStream.commitStream(CommittingOutputStream.java:117) ~[engine.jar:?]
      	at com.sun.jersey.api.client.CommittingOutputStream.write(CommittingOutputStream.java:89) ~[engine.jar:?]
      	at com.fasterxml.jackson.core.json.UTF8JsonGenerator._flushBuffer(UTF8JsonGenerator.java:2177) ~[engine.jar:?]
      	at com.fasterxml.jackson.core.json.UTF8JsonGenerator.flush(UTF8JsonGenerator.java:1190) ~[engine.jar:?]
      	at com.fasterxml.jackson.databind.ObjectWriter.writeValue(ObjectWriter.java:1008) ~[engine.jar:?]
      	at com.fasterxml.jackson.jaxrs.base.ProviderBase.writeTo(ProviderBase.java:626) ~[engine.jar:?]
      	at com.sun.jersey.api.client.RequestWriter.writeRequestEntity(RequestWriter.java:300) ~[engine.jar:?]
      	at com.sun.jersey.client.urlconnection.URLConnectionClientHandler._invoke(URLConnectionClientHandler.java:217) ~[engine.jar:?]
      	at com.sun.jersey.client.urlconnection.URLConnectionClientHandler.handle(URLConnectionClientHandler.java:153) ~[engine.jar:?]
      	... 19 more
      [2024-02-20 09:01:28.757] INFO [pool-5-thread-497] ITask.finishTask:82 
      [30317a65-acf7-483d-9b31-fb0360b77028] Task 30317a65-acf7-483d-9b31-fb0360b77028: [Export] from 2024-02-19T22:00+01:00 to 2024-02-20T04:00+01:00 could not be set to state FAILED
      
      com.sun.jersey.api.client.ClientHandlerException: java.net.ConnectException: Connection refused (Connection refused)
      	at com.sun.jersey.client.urlconnection.URLConnectionClientHandler.handle(URLConnectionClientHandler.java:155) ~[engine.jar:?]
      	at com.sun.jersey.api.client.filter.GZIPContentEncodingFilter.handle(GZIPContentEncodingFilter.java:123) ~[engine.jar:?]
      	at com.sun.jersey.api.client.Client.handle(Client.java:652) ~[engine.jar:?]
      	at com.sun.jersey.api.client.WebResource.handle(WebResource.java:682) ~[engine.jar:?]
      	at com.sun.jersey.api.client.WebResource.access$200(WebResource.java:74) ~[engine.jar:?]
      	at com.sun.jersey.api.client.WebResource$Builder.get(WebResource.java:509) ~[engine.jar:?]
      	at io.swagger.client.ApiClient.getAPIResponse(ApiClient.java:643) ~[engine.jar:?]
      	at io.swagger.client.ApiClient.invokeAPI(ApiClient.java:680) ~[engine.jar:?]
      	at io.swagger.client.api.TaskControllerApi.getTask(TaskControllerApi.java:1217) ~[engine.jar:?]
      	at eu.storware.vprotect.engine.api.controller.TaskController.get(TaskController.java:62) ~[engine.jar:?]
      	at eu.storware.vprotect.engine.task.ITask.finishTask(ITask.java:61) [engine.jar:?]
      	at eu.storware.vprotect.engine.task.ITask.finishTask(ITask.java:52) [engine.jar:?]
      	at eu.storware.vprotect.engine.task.ExportTask.run(ExportTask.java:143) [engine.jar:?]
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
      	at java.lang.Thread.run(Thread.java:829) [?:?]
      Caused by: java.net.ConnectException: Connection refused (Connection refused)
      	at java.net.PlainSocketImpl.socketConnect(Native Method) ~[?:?]
      	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:412) ~[?:?]
      	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:255) ~[?:?]
      	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:237) ~[?:?]
      	at java.net.Socket.connect(Socket.java:609) ~[?:?]
      	at java.net.Socket.connect(Socket.java:558) ~[?:?]
      	at sun.net.NetworkClient.doConnect(NetworkClient.java:182) ~[?:?]
      	at sun.net.www.http.HttpClient.openServer(HttpClient.java:507) ~[?:?]
      	at sun.net.www.http.HttpClient.openServer(HttpClient.java:602) ~[?:?]
      	at sun.net.www.http.HttpClient.<init>(HttpClient.java:275) ~[?:?]
      	at sun.net.www.http.HttpClient.New(HttpClient.java:374) ~[?:?]
      	at sun.net.www.http.HttpClient.New(HttpClient.java:395) ~[?:?]
      	at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1253) ~[?:?]
      	at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1187) ~[?:?]
      	at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1081) ~[?:?]
      	at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:1015) ~[?:?]
      	at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1592) ~[?:?]
      	at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1520) ~[?:?]
      	at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:527) ~[?:?]
      	at com.sun.jersey.client.urlconnection.URLConnectionClientHandler._invoke(URLConnectionClientHandler.java:253) ~[engine.jar:?]
      	at com.sun.jersey.client.urlconnection.URLConnectionClientHandler.handle(URLConnectionClientHandler.java:153) ~[engine.jar:?]
      	... 15 more
      [2024-02-20 09:01:28.789] INFO [pool-5-thread-497] SyntheticBackupProvider.finalizeForTask:273 
      [30317a65-acf7-483d-9b31-fb0360b77028] Finalizing synthetic
      
      
      
    • Hi!

      I am sorry for delay!

      To check your issue we need to look deeper. Could you tell me some information about your environment (Do you use All-in-one installation, How many resources do you have for our software).

      You also have old, not fully supported version. Version 6.1.0 have many changes in area of M365 backup.
      Regards
      Krzysztof

    • Hi @krzysztof-sz

      It's a all-in-one installation ,4 vCPU, 8GB RAM, 20+200GB disks.

      Can you tell me if there's an in-place upgrade path to v 6.1.0 or I've to build from scratch a new VM?

      Thanks and regards,
      Cristian

    • @Cristian-Eglue

      You can try jump from version 6.1.0, but in this case I recommend to make backup of database (after stop the server use /opt/vprotect/scripts/backup_db.sh, it will create backup of db in /tmp), After that you could restore it to clean install like in our documentation: Recovery.

      Regards

    • HI @krzysztof-sz

      Thanks for the tip, I'll give it a try soon and I'll let you know.

      Cristian

    • @krzysztof-sz

      Finally last week I had some spare time to do some tests, I wasn't able to import the old database because after the import the service storware-server stopped to work, anyway I built from the ground up a new VM with Storware 6.1.0-25, and so far it is working fine (except two minor issues that I'll now discuss here). Hope it will not broke in the next days.

      Regards,
      Cristian