| Back to Multiple platform build/check report for BioC 3.24: simplified long |
|
This page was generated on 2026-05-23 11:36 -0400 (Sat, 23 May 2026).
| Hostname | OS | Arch (*) | R version | Installed pkgs |
|---|---|---|---|---|
| nebbiolo2 | Linux (Ubuntu 24.04.4 LTS) | x86_64 | 4.6.0 RC (2026-04-17 r89917) -- "Because it was There" | 4937 |
| kjohnson3 | macOS 13.7.7 Ventura | arm64 | 4.6.0 Patched (2026-05-01 r89994) -- "Because it was There" | 4639 |
| Click on any hostname to see more info about the system (e.g. compilers) (*) as reported by 'uname -p', except on Windows and Mac OS X | ||||
| Package 461/2379 | Hostname | OS / Arch | INSTALL | BUILD | CHECK | BUILD BIN | ||||||||
| COTAN 2.13.1 (landing page) Galfrè Silvia Giulia
| nebbiolo2 | Linux (Ubuntu 24.04.4 LTS) / x86_64 | OK | OK | OK | |||||||||
| kjohnson3 | macOS 13.7.7 Ventura / arm64 | OK | OK | OK | ||||||||||
| See other builds for COTAN in R Universe. | ||||||||||||||
|
To the developers/maintainers of the COTAN package: - Allow up to 24 hours (and sometimes 48 hours) for your latest push to git@git.bioconductor.org:packages/COTAN.git to reflect on this report. See Troubleshooting Build Report for more information. - Use the following Renviron settings to reproduce errors and warnings. - If 'R CMD check' started to fail recently on the Linux builder(s) over a missing dependency, add the missing dependency to 'Suggests:' in your DESCRIPTION file. See Renviron.bioc for more information. |
| Package: COTAN |
| Version: 2.13.1 |
| Command: /Library/Frameworks/R.framework/Resources/bin/R CMD check --install=check:COTAN.install-out.txt --library=/Library/Frameworks/R.framework/Resources/library --no-vignettes --timings COTAN_2.13.1.tar.gz |
| StartedAt: 2026-05-22 18:55:17 -0400 (Fri, 22 May 2026) |
| EndedAt: 2026-05-22 19:04:06 -0400 (Fri, 22 May 2026) |
| EllapsedTime: 529.1 seconds |
| RetCode: 0 |
| Status: OK |
| CheckDir: COTAN.Rcheck |
| Warnings: 0 |
##############################################################################
##############################################################################
###
### Running command:
###
### /Library/Frameworks/R.framework/Resources/bin/R CMD check --install=check:COTAN.install-out.txt --library=/Library/Frameworks/R.framework/Resources/library --no-vignettes --timings COTAN_2.13.1.tar.gz
###
##############################################################################
##############################################################################
* using log directory ‘/Users/biocbuild/bbs-3.24-bioc/meat/COTAN.Rcheck’
* using R version 4.6.0 Patched (2026-05-01 r89994)
* using platform: aarch64-apple-darwin23
* R was compiled by
Apple clang version 17.0.0 (clang-1700.3.19.1)
GNU Fortran (GCC) 14.2.0
* running under: macOS Tahoe 26.3.1
* using session charset: UTF-8
* current time: 2026-05-22 22:55:17 UTC
* using option ‘--no-vignettes’
* checking for file ‘COTAN/DESCRIPTION’ ... OK
* checking extension type ... Package
* this is package ‘COTAN’ version ‘2.13.1’
* package encoding: UTF-8
* checking package namespace information ... OK
* checking package dependencies ... INFO
Imports includes 31 non-default packages.
Importing from so many packages makes the package vulnerable to any of
them becoming unavailable. Move as many as possible to Suggests and
use conditionally.
* checking if this is a source package ... OK
* checking if there is a namespace ... OK
* checking for hidden files and directories ... OK
* checking for portable file names ... OK
* checking for sufficient/correct file permissions ... OK
* checking whether package ‘COTAN’ can be installed ... OK
* checking installed package size ... OK
* checking package directory ... OK
* checking ‘build’ directory ... OK
* checking DESCRIPTION meta-information ... OK
* checking top-level files ... OK
* checking for left-over files ... OK
* checking index information ... OK
* checking package subdirectories ... OK
* checking code files for non-ASCII characters ... OK
* checking R files for syntax errors ... OK
* checking whether the package can be loaded ... OK
* checking whether the package can be loaded with stated dependencies ... OK
* checking whether the package can be unloaded cleanly ... OK
* checking whether the namespace can be loaded with stated dependencies ... OK
* checking whether the namespace can be unloaded cleanly ... OK
* checking whether startup messages can be suppressed ... OK
* checking dependencies in R code ... NOTE
Namespaces in Imports field not imported from:
‘BiocStyle’ ‘GEOquery’ ‘R.utils’ ‘conflicted’
All declared Imports should be used.
* checking S3 generic/method consistency ... OK
* checking replacement functions ... OK
* checking foreign function calls ... OK
* checking R code for possible problems ... OK
* checking Rd files ... OK
* checking Rd metadata ... OK
* checking Rd cross-references ... OK
* checking for missing documentation entries ... OK
* checking for code/documentation mismatches ... OK
* checking Rd \usage sections ... OK
* checking Rd contents ... OK
* checking for unstated dependencies in examples ... OK
* checking contents of ‘data’ directory ... OK
* checking data for non-ASCII characters ... OK
* checking data for ASCII and uncompressed saves ... OK
* checking files in ‘vignettes’ ... OK
* checking examples ... OK
Examples with CPU (user + system) or elapsed time > 5s
user system elapsed
UniformClusters 26.117 0.106 26.219
CalculatingCOEX 21.916 0.027 21.979
HandlingClusterizations 17.855 0.066 17.948
HeatmapPlots 13.389 0.045 13.470
ParametersEstimations 9.038 0.013 9.068
* checking for unstated dependencies in ‘tests’ ... OK
* checking tests ...
Running ‘outputTestDatasetCreation.R’
Running ‘spelling.R’
Running ‘testthat.R’
OK
* checking for unstated dependencies in vignettes ... OK
* checking package vignettes ... OK
* checking running R code from vignettes ... SKIPPED
* checking re-building of vignette outputs ... SKIPPED
* checking PDF version of manual ... OK
* DONE
Status: 1 NOTE
See
‘/Users/biocbuild/bbs-3.24-bioc/meat/COTAN.Rcheck/00check.log’
for details.
COTAN.Rcheck/00install.out
############################################################################## ############################################################################## ### ### Running command: ### ### /Library/Frameworks/R.framework/Resources/bin/R CMD INSTALL COTAN ### ############################################################################## ############################################################################## * installing to library ‘/Library/Frameworks/R.framework/Versions/4.6/Resources/library’ * installing *source* package ‘COTAN’ ... ** this is package ‘COTAN’ version ‘2.13.1’ ** using staged installation ** R ** data ** inst ** byte-compile and prepare package for lazy loading ** help *** installing help indices ** building package indices ** installing vignettes ** testing if installed package can be loaded from temporary location ** testing if installed package can be loaded from final location ** testing if installed package keeps a record of temporary installation path * DONE (COTAN)
COTAN.Rcheck/tests/outputTestDatasetCreation.Rout
R version 4.6.0 Patched (2026-05-01 r89994) -- "Because it was There"
Copyright (C) 2026 The R Foundation for Statistical Computing
Platform: aarch64-apple-darwin23
R is free software and comes with ABSOLUTELY NO WARRANTY.
You are welcome to redistribute it under certain conditions.
Type 'license()' or 'licence()' for distribution details.
R is a collaborative project with many contributors.
Type 'contributors()' for more information and
'citation()' on how to cite R or R packages in publications.
Type 'demo()' for some demos, 'help()' for on-line help, or
'help.start()' for an HTML browser interface to help.
Type 'q()' to quit R.
>
> # Creates the files to be reloaded by the tests for comparisons
>
> # nolint start: object_name_linter
> outputTestDatasetCreation <-
+ function(testsDir = file.path("tests", "testthat")) {
+ utils::data("test.dataset", package = "COTAN")
+ prevOptState <- options(parallelly.fork.enable = TRUE)
+ setLoggingLevel(3L)
+
+ obj <- COTAN(raw = test.dataset)
+ obj <- initializeMetaDataset(objCOTAN = obj, GEO = " ",
+ sequencingMethod = "artificial",
+ sampleCondition = "test")
+
+ obj <- proceedToCoex(objCOTAN = obj, cores = 6L, saveObj = FALSE)
+
+ if (FALSE) {
+ saveRDS(obj, file = file.path(testsDir, "test.COTAN.RDS"))
+ }
+
+ cells.names.test <-
+ getCells(objCOTAN = obj)[c(1L:10L, 591L:610L, 991L:1000L)]
+ genes.names.test <-
+ getGenes(objCOTAN = obj)[c(131L:140L, 291L:310L, 591L: 600L)]
+ saveRDS(cells.names.test, file.path(testsDir, "cells.names.test.RDS"))
+ saveRDS(genes.names.test, file.path(testsDir, "genes.names.test.RDS"))
+
+ pcaRaw <- runPCA(x = getRawData(objCOTAN = obj), rank = 10L,
+ BSPARAM = IrlbaParam(), get.rotation = FALSE)[["x"]]
+
+ pca.raw.test <- pcaRaw[genes.names.test, ]
+ saveRDS(pca.raw.test, file.path(testsDir, "pca.raw.test.RDS"))
+
+ dispersion.test <- getDispersion(objCOTAN = obj)[genes.names.test]
+ saveRDS(dispersion.test, file.path(testsDir, "dispersion.test.RDS"))
+
+ raw.norm.test <-
+ getNuNormData(objCOTAN = obj)[genes.names.test, cells.names.test]
+ saveRDS(raw.norm.test, file.path(testsDir, "raw.norm.test.RDS"))
+
+ coex.test <-
+ getGenesCoex(objCOTAN = obj, genes = genes.names.test, zeroDiagonal = FALSE)
+ saveRDS(coex.test, file.path(testsDir, "coex.test.RDS"))
+
+ lambda.test <- getLambda(objCOTAN = obj)[genes.names.test]
+ saveRDS(lambda.test, file.path(testsDir, "lambda.test.RDS"))
+
+ GDI.test <- calculateGDI(objCOTAN = obj)
+ GDI.test <- GDI.test[genes.names.test, ]
+ saveRDS(GDI.test, file.path(testsDir, "GDI.test.RDS"))
+
+ nu.test <- getNu(objCOTAN = obj)[cells.names.test]
+ saveRDS(nu.test, file.path(testsDir, "nu.test.RDS"))
+
+ pvalues.test <- calculatePValue(objCOTAN = obj,
+ geneSubsetCol = genes.names.test,
+ geneSubsetRow = genes.names.test)
+ saveRDS(pvalues.test, file.path(testsDir, "pvalues.test.RDS"))
+
+ groupMarkers <- list(G1 = c("g-000010", "g-000020", "g-000138"),
+ G2 = c("g-000300", "g-000330", "g-000660"),
+ G3 = c("g-000510", "g-000530", "g-000550",
+ "g-000570", "g-000590"))
+
+ gcsData <- genesCoexSpace(objCOTAN = obj,
+ primaryMarkers = unlist(groupMarkers),
+ numGenesPerMarker = 11L)
+
+ genes.coex.space.test <- gcsData[["GCS"]]
+ saveRDS(genes.coex.space.test,
+ file.path(testsDir, "genes.coex.space.test.RDS"))
+
+ genesClustersData <-
+ establishGenesClusters(objCOTAN = obj,
+ groupMarkers = groupMarkers,
+ numGenesPerMarker = 11L,
+ kCuts = 6L, distance = "cosine",
+ hclustMethod = "ward.D2")
+
+ pca.genes.clusters.test <- genesClustersData[["pca_clusters"]]
+ saveRDS(pca.genes.clusters.test,
+ file.path(testsDir, "pca.genes.clusters.test.RDS"))
+
+ # Make it a less strict check as it is only for testing
+ checker <- new("AdvancedGDIUniformityCheck")
+ checker <- shiftCheckerThresholds(checker, 0.1)
+
+ initialResolution <- 1.3
+ splitData <- cellsUniformClustering(objCOTAN = obj,
+ checker = checker,
+ initialResolution = initialResolution,
+ useCoexEigen = TRUE,
+ dataMethod = "LL",
+ numReducedComp = 50L,
+ cores = 6L, optimizeForSpeed = TRUE,
+ deviceStr = "cuda", saveObj = FALSE)
+
+ split.clusters.test <- splitData[["clusters"]]
+ saveRDS(split.clusters.test,
+ file = file.path(testsDir, "split.clusters.test.RDS"))
+
+ test.dataset.clusters1 <- split.clusters.test
+ save(test.dataset.clusters1, compress = TRUE,
+ file = file.path("data", "test.dataset.clusters1.rda"))
+
+ obj <- addClusterization(objCOTAN = obj,
+ clName = "split",
+ clusters = splitData[["clusters"]],
+ coexDF = splitData[["coex"]])
+
+ coex.clusters.test <- splitData[["coex"]][genes.names.test, ]
+ saveRDS(coex.clusters.test, file.path(testsDir, "coex.clusters.test.RDS"))
+
+ pvalDF <- pValueFromDEA(splitData[["coex"]],
+ getNumCells(objCOTAN = obj),
+ adjustmentMethod = "none")
+
+ pvalues.clusters.test <- pvalDF[genes.names.test, ]
+ saveRDS(pvalues.clusters.test,
+ file.path(testsDir, "pvalues.clusters.test.RDS"))
+
+ mergedData <- mergeUniformCellsClusters(objCOTAN = obj,
+ clusters = splitData[["clusters"]],
+ checkers = checker,
+ batchSize = 1L,
+ cores = 6L,
+ distance = "cosine",
+ hclustMethod = "ward.D2",
+ saveObj = FALSE)
+
+ merge.clusters.test <- mergedData[["clusters"]]
+ saveRDS(merge.clusters.test,
+ file = file.path(testsDir, "merge.clusters.test.RDS"))
+
+ test.dataset.clusters2 <- merge.clusters.test
+ save(test.dataset.clusters2, compress = TRUE,
+ file = file.path("data", "test.dataset.clusters2.rda"))
+
+ obj <- addClusterization(objCOTAN = obj,
+ clName = "merge",
+ clusters = mergedData[["clusters"]],
+ coexDF = mergedData[["coex"]])
+
+ options(prevOptState)
+ }
> # nolint end
>
> proc.time()
user system elapsed
0.094 0.024 0.112
COTAN.Rcheck/tests/spelling.Rout
R version 4.6.0 Patched (2026-05-01 r89994) -- "Because it was There"
Copyright (C) 2026 The R Foundation for Statistical Computing
Platform: aarch64-apple-darwin23
R is free software and comes with ABSOLUTELY NO WARRANTY.
You are welcome to redistribute it under certain conditions.
Type 'license()' or 'licence()' for distribution details.
R is a collaborative project with many contributors.
Type 'contributors()' for more information and
'citation()' on how to cite R or R packages in publications.
Type 'demo()' for some demos, 'help()' for on-line help, or
'help.start()' for an HTML browser interface to help.
Type 'q()' to quit R.
> if (requireNamespace("spelling", quietly = TRUE))
+ spelling::spell_check_test(vignettes = TRUE, error = FALSE,
+ skip_on_cran = TRUE)
All Done!
>
> proc.time()
user system elapsed
0.077 0.026 0.095
COTAN.Rcheck/tests/testthat.Rout
R version 4.6.0 Patched (2026-05-01 r89994) -- "Because it was There"
Copyright (C) 2026 The R Foundation for Statistical Computing
Platform: aarch64-apple-darwin23
R is free software and comes with ABSOLUTELY NO WARRANTY.
You are welcome to redistribute it under certain conditions.
Type 'license()' or 'licence()' for distribution details.
R is a collaborative project with many contributors.
Type 'contributors()' for more information and
'citation()' on how to cite R or R packages in publications.
Type 'demo()' for some demos, 'help()' for on-line help, or
'help.start()' for an HTML browser interface to help.
Type 'q()' to quit R.
> Sys.setenv(R_TESTS = "")
> library(testthat)
> library(COTAN)
> library(zeallot)
> test_check("COTAN")
Setting new log level to 4
Initializing `COTAN` meta-data
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [10] genes and [20] cells
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 0.761075019836426
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.903596292963576 | max: 4.67949426963453 | % negative: 10
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 1.08507895469666
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.000221014022827148
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.00313591957092285
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.368441104888916
Total calculations elapsed time: 1.45687699317932
Calculate genes' COEX (legacy): DONE
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [10] genes and [20] cells
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 5 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 4 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 2.26635813713074
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.903596292963576 | max: 4.67949426963453 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 7 cells batches
Total calculations elapsed time: 0.356243133544922
Estimate `nu`: DONE
`nu` change (abs) | max: 1.75595238095238 | median: 1.07156808035714 | mean: 1.07156808035714
Estimate `dispersion`/`nu`: START
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 0.71160101890564
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 1.03734183779544 | max: 4.61112297272667 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.353984117507935
Estimate `nu`: DONE
`nu` change (abs) | max: 0.0295487661210321 | median: 0.016072261901129 | mean: 0.016072261901129
`nu` mean: 1.69786080481514
Marginal errors | max: 1.95799528048 | median 1.32268477389029 | mean: 1.33563364783916
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 0.730662107467651
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.0585450475968788 | max: 3.52739274166646 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.352809906005859
Estimate `nu`: DONE
`nu` change (abs) | max: 0.417150556912302 | median: 0.240156504520849 | mean: 0.240156504520849
`nu` mean: 0.823005947608547
Marginal errors | max: 0.837672524335755 | median 0.704691669139065 | mean: 0.646575831699997
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 0.742331981658936
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.328845855849147 | max: 4.03031691940854 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.373214960098267
Estimate `nu`: DONE
`nu` change (abs) | max: 0.164439840041 | median: 0.0957105992188852 | mean: 0.0957105992188852
`nu` mean: 1.06872924082212
Marginal errors | max: 0.260109847946692 | median 0.21392791155499 | mean: 0.197565106613054
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 0.72908091545105
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.229469002841045 | max: 3.87206403670079 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.38518500328064
Estimate `nu`: DONE
`nu` change (abs) | max: 0.05539667181205 | median: 0.0321044921874999 | mean: 0.0321044921874999
`nu` mean: 0.97670782037545
Marginal errors | max: 0.095347789718808 | median 0.0796003827042702 | mean: 0.0725509735761708
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 0.70873498916626
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.263830434255107 | max: 3.92953043775907 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.343971014022827
Estimate `nu`: DONE
`nu` change (abs) | max: 0.0196209299693411 | median: 0.0114037947200925 | mean: 0.0114037947200925
`nu` mean: 1.00821713524925
Marginal errors | max: 0.0329495161656741 | median 0.0273479725376307 | mean: 0.0250296751521306
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 0.758626937866211
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.251734659898779 | max: 3.9096133246649 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.374698162078857
Estimate `nu`: DONE
`nu` change (abs) | max: 0.0069104540740097 | median: 0.0040109538496062 | mean: 0.0040109538496062
`nu` mean: 0.997100499775596
Marginal errors | max: 0.0116950057438405 | median 0.00972280144873938 | mean: 0.00889105008777555
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 0.70096492767334
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.256009779031907 | max: 3.91667271750655 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.35402512550354
Estimate `nu`: DONE
`nu` change (abs) | max: 0.00251004753849005 | median: 0.00146484374999994 | mean: 0.00146484374999994
`nu` mean: 1.00104520378849
Marginal errors | max: 0.00430755646112857 | median 0.00358203399504298 | mean: 0.00327684342604027
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 0.695810079574585
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.254429717857093 | max: 3.91406908073254 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.353641033172607
Estimate `nu`: DONE
`nu` change (abs) | max: 0.00104629156456748 | median: 0.000592910406456731 | mean: 0.000592910406456731
`nu` mean: 0.999546618841889
Marginal errors | max: 0.00162038706091039 | median 0.00134441676098973 | mean: 0.00123030512553282
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 0.683552980422974
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.255022049769696 | max: 3.91504587939868 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.353868961334229
Estimate `nu`: DONE
`nu` change (abs) | max: 0.000418450901304768 | median: 0.000244140625000028 | mean: 0.000244140625000028
`nu` mean: 1.0001743102763
Marginal errors | max: 0.00071569233034019 | median 0.000597297218559056 | mean: 0.000545906995079193
Total calculations elapsed time: 19.4967958927155
Estimate `dispersion`/`nu`: DONE
Estimate `dispersion`/`nu`: START
Initializing `COTAN` meta-data
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [10] genes and [20] cells
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 0.7170569896698
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.903596292963576 | max: 4.67949426963453 | % negative: 10
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 1.12020206451416
Calculating genes' COEX normalization factor
Fraction of genes' with very low expected contingency tables: 0.181818181818182
Calculate genes' normalization factor elapsed time: 0.000277996063232422
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0012519359588623
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.379158973693848
Total calculations elapsed time: 1.5008909702301
Calculate genes' COEX (legacy): DONE
Calculate cells' COEX (legacy): START
Retrieving expected cells' contingency table
calculating NN.. done
calculating YN..NY..YY..t().. done
Expected cells' contingency table elapsed time: 1.13104701042175
Calculating cells' COEX normalization factor
Fraction of cells' with very low expected contingency tables: 0
Calculate cells' normalization factor elapsed time: 0.00030517578125
Retrieving observed cells' yes/yes contingency table
calculating YY.. done
Observed cells' contingency table elapsed time: 0.00105500221252441
Estimating cells' COEX
Calculate cells' COEX elapsed time: 0.391331911087036
Total calculations elapsed time: 1.52373909950256
Calculate cells' COEX (legacy): DONE
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.00420904159545898
Calculate `GDI`: DONE
Total calculations elapsed time: 0.387101173400879
Calculate GDI dataframe: DONE
'as(<dgeMatrix>, "dgCMatrix")' is deprecated.
Use 'as(., "CsparseMatrix")' instead.
See help("Deprecated") and help("Matrix-deprecated").
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.000699043273925781
Calculate `GDI`: DONE
Total calculations elapsed time: 0.388944864273071
Calculate GDI dataframe: DONE
Included 1 genes with GDI below 1.3
Selected 10 genes using HGDI selector
Running genes' selection: DONE
Running genes' selection: START
Included 1 genes with GDI below 1.3
Selected 10 genes using HGDI selector
Running genes' selection: DONE
Running genes' selection: START
Included 1 genes with GDI below 1.3
Selected 10 genes using HGDI selector
Running genes' selection: DONE
Running genes' selection: START
Selected 5 genes using HGDI selector
Running genes' selection: DONE
Running genes' selection: START
Normalizing layer: counts
Performing log-normalization
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Finding variable features for layer counts
Calculating gene variances
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Calculating feature variances of standardized and clipped values
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Selected 5 genes using HVG_Seurat selector
Running genes' selection: DONE
Running genes' selection: START
Normalizing layer: counts
Performing log-normalization
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Finding variable features for layer data
Calculating gene means
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Calculating gene variance to mean ratios
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Running genes' selection: START
Given 5 genes as input
Running genes' selection: DONE
Elaborating Reduced dimensionality Data Matrix - START
Running genes' selection: START
Included 1 genes with GDI below 1.3
Selected 10 genes using HGDI selector
Running genes' selection: DONE
Elaborating PCA - START
Elaborating PCA - DONE
Total calculations elapsed time: 0.747029781341553
Elaborating Reduced dimensionality Data Matrix - DONE
Elaborating Reduced dimensionality Data Matrix - START
Running genes' selection: START
Included 1 genes with GDI below 1.3
Selected 10 genes using HGDI selector
Running genes' selection: DONE
Elaborating PCA - START
Elaborating PCA - DONE
Total calculations elapsed time: 0.807403087615967
Elaborating Reduced dimensionality Data Matrix - DONE
Elaborating Reduced dimensionality Data Matrix - START
Running genes' selection: START
Selected 8 genes using HGDI selector
Running genes' selection: DONE
Elaborating PCA - START
Elaborating PCA - DONE
Total calculations elapsed time: 0.742271900177002
Elaborating Reduced dimensionality Data Matrix - DONE
Elaborating Reduced dimensionality Data Matrix - START
Running genes' selection: START
Normalizing layer: counts
Performing log-normalization
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Finding variable features for layer counts
Calculating gene variances
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Calculating feature variances of standardized and clipped values
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Selected 8 genes using HVG_Seurat selector
Running genes' selection: DONE
Elaborating PCA - START
Elaborating PCA - DONE
Total calculations elapsed time: 1.14364814758301
Elaborating Reduced dimensionality Data Matrix - DONE
Elaborating Reduced dimensionality Data Matrix - START
Elaborating COEX Eigen Vectors - START
Elaborating COEX Eigen Vectors - DONE
Total calculations elapsed time: 1.18003392219543
Elaborating Reduced dimensionality Data Matrix - DONE
Elaborating Reduced dimensionality Data Matrix - START
Elaborating COEX Eigen Vectors - START
Elaborating COEX Eigen Vectors - DONE
Total calculations elapsed time: 1.12820792198181
Elaborating Reduced dimensionality Data Matrix - DONE
Initializing `COTAN` meta-data
Initializing `COTAN` meta-data
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [10] genes and [20] cells
Estimate `dispersion`/`nu`: START
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 0.742816925048828
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.903596292963576 | max: 4.67949426963453 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.392513990402222
Estimate `nu`: DONE
`nu` change (abs) | max: 1.75719246031746 | median: 1.07229953342014 | mean: 1.07229953342014
`nu` mean: 1.68489292689732
Marginal errors | max: 1.735699617106 | median 1.3799744133366 | mean: 1.32181397451301
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 0.718728065490723
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.0655494303592343 | max: 3.54400580804152 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.354722023010254
Estimate `nu`: DONE
`nu` change (abs) | max: 0.402649984216273 | median: 0.231868788425666 | mean: 0.231868788425666
`nu` mean: 0.829218804209393
Marginal errors | max: 0.803248939260364 | median 0.677504196374571 | mean: 0.619386446933351
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 0.717463970184326
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.326019058449519 | max: 4.02612397202046 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.411270141601562
Estimate `nu`: DONE
`nu` change (abs) | max: 0.158004893526231 | median: 0.0919692884670312 | mean: 0.0919692884670312
`nu` mean: 1.0660356050592
Marginal errors | max: 0.25067700287536 | median 0.206241644985115 | mean: 0.190402167377958
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 0.766473054885864
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.230397316576369 | max: 3.87365659194104 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.387923955917358
Estimate `nu`: DONE
`nu` change (abs) | max: 0.0532774732102337 | median: 0.0308837890624999 | mean: 0.0308837890624999
`nu` mean: 0.977606315852266
Marginal errors | max: 0.0916920322976189 | median 0.0765360853958175 | mean: 0.0697673030094082
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 0.783259153366089
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.263457616228195 | max: 3.928924407347 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.367440223693848
Estimate `nu`: DONE
`nu` change (abs) | max: 0.0187878665732679 | median: 0.0109155550210726 | mean: 0.0109155550210726
`nu` mean: 1.0078723115522
Marginal errors | max: 0.0315207323253404 | median 0.0261635598193228 | mean: 0.0239435763640456
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 0.78396487236023
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.251890641847533 | max: 3.90987172241566 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.360644817352295
Estimate `nu`: DONE
`nu` change (abs) | max: 0.00649137083358098 | median: 0.00376680890457393 | mean: 0.00376680890457393
`nu` mean: 0.997275438070993
Marginal errors | max: 0.0109748802265024 | median 0.00912386940474885 | mean: 0.00834350038184262
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 0.741404056549072
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.255902752363649 | max: 3.91649655995187 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.373467922210693
Estimate `nu`: DONE
`nu` change (abs) | max: 0.00230094227000666 | median: 0.00132529141000018 | mean: 0.00132529141000018
`nu` mean: 1.00097565086001
Marginal errors | max: 0.00376864912836616 | median 0.00313421412286008 | mean: 0.00286709489297596
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 0.777005910873413
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.254520292119112 | max: 3.91421850264948 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.386441946029663
Estimate `nu`: DONE
`nu` change (abs) | max: 0.000837013154366462 | median: 0.000488281250000028 | mean: 0.000488281250000028
`nu` mean: 0.999651268095634
Marginal errors | max: 0.00144055320514802 | median 0.00119489364392944 | mean: 0.00109355439757213
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 0.746013164520264
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.255046800817986 | max: 3.91508667609651 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 1 cells batches
Total calculations elapsed time: 0.374150991439819
Estimate `nu`: DONE
`nu` change (abs) | max: 0.000418448154490214 | median: 0.000244140624999917 | mean: 0.000244140624999917
`nu` mean: 1.00017430752949
Marginal errors | max: 0.000715683388516908 | median 0.0005972847342397 | mean: 0.00054589991652314
Total calculations elapsed time: 20.4631719589233
Estimate `dispersion`/`nu`: DONE
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 1.11549997329712
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.000216960906982422
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.00049591064453125
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.381065130233765
Total calculations elapsed time: 1.4972779750824
Calculate genes' COEX (legacy): DONE
Calculate cells' COEX (legacy): START
Retrieving expected cells' contingency table
calculating NN.. done
calculating YN..NY..YY..t().. done
Expected cells' contingency table elapsed time: 1.12995100021362
Calculating cells' COEX normalization factor
Calculate cells' normalization factor elapsed time: 0.000252962112426758
Retrieving observed cells' yes/yes contingency table
calculating YY.. done
Observed cells' contingency table elapsed time: 0.000560998916625977
Estimating cells' COEX
Calculate cells' COEX elapsed time: 0.402695178985596
Total calculations elapsed time: 1.53346014022827
Calculate cells' COEX (legacy): DONE
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.000706911087036133
Calculate `GDI`: DONE
Total calculations elapsed time: 0.367990970611572
Calculate GDI dataframe: DONE
Calculate genes' partial COEX: START
Retrieving expected genes' partial contingency table
calculating partial NN.. done
calculating partial NY..YN..YY.. done
Calculating genes' partial COEX normalization factor
Fraction of genes with very low expected contingency tables: 0.325
Retrieving observed genes' yes/yes partial contingency table
calculating partial YY.. done
Estimating genes' partial COEX
Total calculations elapsed time: 3.04667091369629
Calculate genes' partial COEX: DONE
Calculate cells' partial COEX: START
Retrieving expected cells' partial contingency table
calculating partial NN.. done
calculating partial YN..NY..YY.. done
Calculating cells' partial COEX normalization factor
Fraction of genes with very low expected contingency tables: 0
Retrieving observed cells' yes/yes partial contingency table
calculating partial YY.. done
Estimating cells' partial COEX
Total calculations elapsed time: 3.04611492156982
Calculate cells' partial COEX: DONE
Asked to drop 2 genes and 0 cells
Asked to drop 0 genes and 4 cells
Asked to drop 2 genes and 2 cells
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [10] genes and [20] cells
calculating YY.. done
calculating YY.. done
calculating YN..NY..NN..t().. done
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 3 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.55447697639465
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.903596292963576 | max: 4.67949426963453 | % negative: 10
calculating NN.. done
calculating NN.. done
calculating NY..YN..YY..t().. done
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 1.14271402359009
Calculating genes' COEX normalization factor
Fraction of genes' with very low expected contingency tables: 0.181818181818182
Calculate genes' normalization factor elapsed time: 0.000268936157226562
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.000479936599731445
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.372822046279907
Total calculations elapsed time: 1.51628494262695
Calculate genes' COEX (legacy): DONE
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 1.17383289337158
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00020909309387207
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.000473976135253906
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.413762092590332
Total calculations elapsed time: 1.58827805519104
Calculate genes' COEX (legacy): DONE
Calculate genes' partial COEX: START
Retrieving expected genes' partial contingency table
calculating partial NN.. done
calculating partial NY..YN..YY.. done
Calculating genes' partial COEX normalization factor
Fraction of genes with very low expected contingency tables: 0.1
Retrieving observed genes' yes/yes partial contingency table
calculating partial YY.. done
Estimating genes' partial COEX
Total calculations elapsed time: 3.09488201141357
Calculate genes' partial COEX: DONE
Calculate genes' partial COEX: START
Retrieving expected genes' partial contingency table
calculating partial NN.. done
calculating partial NY..YN..YY.. done
Calculating genes' partial COEX normalization factor
Fraction of genes with very low expected contingency tables: 0.4
Retrieving observed genes' yes/yes partial contingency table
calculating partial YY.. done
Estimating genes' partial COEX
Total calculations elapsed time: 3.01704907417297
Calculate genes' partial COEX: DONE
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [10] genes and [20] cells
calculating YY.. done
calculating YY.. done
calculating NY..YN..NN..t().. done
Estimate `dispersion`/`nu`: START
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 3 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.51549482345581
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.903596292963576 | max: 4.67949426963453 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 5 cells batches
Total calculations elapsed time: 0.379714012145996
Estimate `nu`: DONE
`nu` change (abs) | max: 1.75719246031746 | median: 1.07229953342014 | mean: 1.07229953342014
`nu` mean: 1.68489292689732
Marginal errors | max: 0.255290533439036 | median 0.0807313765005375 | mean: 0.101968565509113
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 3 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.56316494941711
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 1.03709166563768 | max: 4.61069655774133 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 5 cells batches
Total calculations elapsed time: 0.399669885635376
Estimate `nu`: DONE
`nu` change (abs) | max: 0.0273438105507502 | median: 0.0148852611818011 | mean: 0.0148852611818011
`nu` mean: 1.69735147626627
Marginal errors | max: 0.00330148418741771 | median 0.00111713187082163 | mean: 0.00132007186542999
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 3 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.55181121826172
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 1.03887279473672 | max: 4.60974134092906 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 5 cells batches
Total calculations elapsed time: 0.38107180595398
Estimate `nu`: DONE
`nu` change (abs) | max: 0 | median: 0 | mean: 0
`nu` mean: 1.69735147626627
Marginal errors | max: 5.14174422185931e-05 | median 1.6818224857218e-07 | mean: 5.57649710835051e-06
Total calculations elapsed time: 9.32900404930115
Estimate `dispersion`/`nu`: DONE
calculating NN.. done
calculating NN.. done
calculating YN..NY..YY..t().. done
Calculate cells' COEX (legacy): START
Retrieving expected cells' contingency table
calculating NN.. done
calculating YN..NY..YY..t().. done
Expected cells' contingency table elapsed time: 1.19736886024475
Calculating cells' COEX normalization factor
Fraction of cells' with very low expected contingency tables: 0
Calculate cells' normalization factor elapsed time: 0.000341176986694336
Retrieving observed cells' yes/yes contingency table
calculating YY.. done
Observed cells' contingency table elapsed time: 0.000608921051025391
Estimating cells' COEX
Calculate cells' COEX elapsed time: 0.408601999282837
Total calculations elapsed time: 1.60692095756531
Calculate cells' COEX (legacy): DONE
Calculate cells' partial COEX: START
Retrieving expected cells' partial contingency table
calculating partial NN.. done
calculating partial YN..NY..YY.. done
Calculating cells' partial COEX normalization factor
Fraction of genes with very low expected contingency tables: 0
Retrieving observed cells' yes/yes partial contingency table
calculating partial YY.. done
Estimating cells' partial COEX
Total calculations elapsed time: 3.13653302192688
Calculate cells' partial COEX: DONE
Calculate cells' partial COEX: START
Retrieving expected cells' partial contingency table
calculating partial NN.. done
calculating partial YN..NY..YY.. done
Calculating cells' partial COEX normalization factor
Fraction of genes with very low expected contingency tables: 0
Retrieving observed cells' yes/yes partial contingency table
calculating partial YY.. done
Estimating cells' partial COEX
Total calculations elapsed time: 3.07752299308777
Calculate cells' partial COEX: DONE
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [10] genes and [20] cells
Estimate `dispersion`/`nu`: START
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 3 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.55321621894836
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 0.903596292963576 | max: 4.67949426963453 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 5 cells batches
Total calculations elapsed time: 0.3854660987854
Estimate `nu`: DONE
`nu` change (abs) | max: 1.75719246031746 | median: 1.07229953342014 | mean: 1.07229953342014
`nu` mean: 1.68489292689732
Marginal errors | max: 0.255290533439036 | median 0.0807313765005375 | mean: 0.101968565509113
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 3 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.52386283874512
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 1.03709166563768 | max: 4.61069655774133 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 5 cells batches
Total calculations elapsed time: 0.394926071166992
Estimate `nu`: DONE
`nu` change (abs) | max: 0.0273438105507502 | median: 0.0148852611818011 | mean: 0.0148852611818011
`nu` mean: 1.69735147626627
Marginal errors | max: 0.00330148418741771 | median 0.00111713187082163 | mean: 0.00132007186542999
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 3 genes batches
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Parallel dispersion Newton-Raphson: used up to 5 iterations
Total calculations elapsed time: 1.50486397743225
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: 1.03887279473672 | max: 4.60974134092906 | % negative: 10
Estimate `nu`: START
Effective number of cores used: 1
Executing 5 cells batches
Total calculations elapsed time: 0.399536848068237
Estimate `nu`: DONE
`nu` change (abs) | max: 0 | median: 0 | mean: 0
`nu` mean: 1.69735147626627
Marginal errors | max: 5.14174422185931e-05 | median 1.6818224857218e-07 | mean: 5.57649710835051e-06
Total calculations elapsed time: 9.26405596733093
Estimate `dispersion`/`nu`: DONE
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 1.18399381637573
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.000199079513549805
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.000491142272949219
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.369430780410767
Total calculations elapsed time: 1.554114818573
Calculate genes' COEX (legacy): DONE
Calculating S: START
Calculating S: DONE
Calculating G: START
calculating YY.. done
calculating YN..NY..NN..t().. done
calculating NN.. done
calculating NY..YN..YY..t().. done
Estimating G
Total calculations elapsed time: 2.82014918327332
Calculating G: DONE
Using S
Calculating S: START
Calculating S: DONE
calculating PValues: START
Get p-values genome wide on columns and genome wide on rows
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.00156688690185547
calculating PValues: DONE
Using G
Calculating G: START
calculating YY.. done
calculating YN..NY..NN..t().. done
calculating NN.. done
calculating NY..YN..YY..t().. done
Estimating G
Total calculations elapsed time: 2.7286388874054
Calculating G: DONE
calculating PValues: START
Get p-values on a set of genes on columns and on a set of genes on rows
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 2.73238205909729
calculating PValues: DONE
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.000669956207275391
Calculate `GDI`: DONE
Total calculations elapsed time: 0.381299018859863
Calculate GDI dataframe: DONE
Calculate GDI dataframe: START
Using G
Calculating G: START
calculating YY.. done
calculating YN..NY..NN..t().. done
calculating NN.. done
calculating NY..YN..YY..t().. done
Estimating G
Total calculations elapsed time: 2.74643707275391
Calculating G: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.000914812088012695
Calculate `GDI`: DONE
Total calculations elapsed time: 3.14575815200806
Calculate GDI dataframe: DONE
Calculate `GDI`: START
Calculating S: START
Calculating S: DONE
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.00157308578491211
Calculate `GDI`: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.000843048095703125
Calculate `GDI`: DONE
Initializing `COTAN` meta-data
COTAN dataset analysis: START
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Dataset cleaning elapsed time: 0.366876840591431
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 0.832207918167114
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916524 | max: 462.908586418992 | % negative: 17.3333333333333
Model parameter estimation elapsed time: 1.19759106636047
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 1.53843998908997
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00333094596862793
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0265741348266602
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.376219034194946
Total calculations elapsed time: 1.9445641040802
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 2.32231187820435
Dataset analysis elapsed time: 3.88677978515625
COTAN dataset analysis: DONE
Initializing `COTAN` meta-data
Condition test
n cells 1000
COTAN dataset analysis: START
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Dataset cleaning elapsed time: 0.37895393371582
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 0.864170074462891
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916524 | max: 462.908586418992 | % negative: 17.3333333333333
Model parameter estimation elapsed time: 1.24143099784851
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 1.51645517349243
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00336194038391113
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0264499187469482
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.392512083053589
Total calculations elapsed time: 1.93877911567688
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 2.32220101356506
Dataset analysis elapsed time: 3.94258594512939
COTAN dataset analysis: DONE
Using S
Calculating S: START
Calculating S: DONE
calculating PValues: START
Get p-values on a set of genes on columns and on a set of genes on rows
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.00936508178710938
calculating PValues: DONE
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0149040222167969
Calculate `GDI`: DONE
Total calculations elapsed time: 0.411264896392822
Calculate GDI dataframe: DONE
Initializing `COTAN` meta-data
Condition test
n cells 1000
COTAN dataset analysis: START
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Dataset cleaning elapsed time: 0.38258695602417
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 0.814252853393555
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916524 | max: 462.908586418992 | % negative: 17.3333333333333
Model parameter estimation elapsed time: 1.20640993118286
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 1.53147411346436
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00332283973693848
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0262010097503662
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.380162000656128
Total calculations elapsed time: 1.94115996360779
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 2.31852412223816
Dataset analysis elapsed time: 3.90752100944519
COTAN dataset analysis: DONE
Using S
Calculating S: START
Calculating S: DONE
calculating PValues: START
Get p-values genome wide on columns and on a set of genes on rows
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.00600099563598633
calculating PValues: DONE
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0155420303344727
Calculate `GDI`: DONE
Total calculations elapsed time: 0.394245147705078
Calculate GDI dataframe: DONE
Initializing `COTAN` meta-data
Condition test
n cells 1000
COTAN dataset analysis: START
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Dataset cleaning elapsed time: 0.365167140960693
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 0.804759979248047
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916524 | max: 462.908586418992 | % negative: 17.3333333333333
Model parameter estimation elapsed time: 1.19019484519958
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 1.55042290687561
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.0039370059967041
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.025792121887207
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.381749868392944
Total calculations elapsed time: 1.96190190315247
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 2.38696694374084
Dataset analysis elapsed time: 3.94232892990112
COTAN dataset analysis: DONE
Using S
Calculating S: START
Calculating S: DONE
calculating PValues: START
Get p-values on a set of genes on columns and on a set of genes on rows
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.00218105316162109
calculating PValues: DONE
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0157930850982666
Calculate `GDI`: DONE
Total calculations elapsed time: 0.410558938980103
Calculate GDI dataframe: DONE
Initializing `COTAN` meta-data
Asked to drop 0 genes and 960 cells
COTAN dataset analysis: START
Asked to drop 83 genes and 0 cells
Genes/cells selection done: dropped [83] genes and [0] cells
Working on [517] genes and [40] cells
Dataset cleaning elapsed time: 0.39357590675354
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 0.757417917251587
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.267567793681876 | max: 101.923257389521 | % negative: 52.6112185686654
Model parameter estimation elapsed time: 1.14732813835144
COTAN genes' COEX estimation not requested
Only genes' COEX elapsed time: 0.409896850585938
Dataset analysis elapsed time: 1.95080089569092
COTAN dataset analysis: DONE
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 1.23768997192383
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00203800201416016
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.00481390953063965
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.388657093048096
Total calculations elapsed time: 1.63319897651672
Calculate genes' COEX (legacy): DONE
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 1.25239706039429
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00229096412658691
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.00480794906616211
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.418905019760132
Total calculations elapsed time: 1.67840099334717
Calculate genes' COEX (legacy): DONE
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 1.21779084205627
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00196313858032227
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.00471997261047363
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.412767887115479
Total calculations elapsed time: 1.63724184036255
Calculate genes' COEX (legacy): DONE
Hangling COTAN object with condition: test
Using S
Calculating S: START
Calculating S: DONE
calculating PValues: START
Get p-values on a set of genes on columns and on a set of genes on rows
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.00208806991577148
calculating PValues: DONE
Handling genes type: G2
Handling genes type: G3
Initializing `COTAN` meta-data
COTAN dataset analysis: START
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Clean plots: START
PCA: START
PCA: DONE
Hierarchical clustering: START
Hierarchical clustering: DONE
Total calculations elapsed time: 0.882811069488525
Clean plots: DONE
Dataset cleaning elapsed time: 1.81575298309326
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 0.869440078735352
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916524 | max: 462.908586418992 | % negative: 17.3333333333333
Model parameter estimation elapsed time: 1.30948305130005
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 1.64633917808533
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00702881813049316
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0254380702972412
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.410738945007324
Total calculations elapsed time: 2.08954501152039
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 2.50541806221008
Dataset analysis elapsed time: 5.63065409660339
COTAN dataset analysis: DONE
Saving elaborated data locally at: /var/folders/r0/l4fjk6cj5xj0j3brt4bplpl40000gt/T//RtmpOjTfuA/test.cotan.RDS
Creating new clusterization: START
Elaborating Reduced dimensionality Data Matrix - START
Elaborating COEX Eigen Vectors - START
Elaborating COEX Eigen Vectors - DONE
Total calculations elapsed time: 1.29422402381897
Elaborating Reduced dimensionality Data Matrix - DONE
Computing nearest neighbor graph
Computing SNN
Modularity Optimizer version 1.3.0 by Ludo Waltman and Nees Jan van Eck
Number of nodes: 1000
Number of edges: 44886
Running Louvain algorithm with multilevel refinement...
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Maximum modularity in 10 random starts: 0.4008
Number of communities: 4
Elapsed time: 0 seconds
Used resolution for Seurat clusterization is: 1.3
Total calculations elapsed time: 1.68076109886169
Creating new clusterization: DONE
Creating cells' uniform clustering: START
In iteration 1 the number of cells to re-cluster is 1000 cells belonging to 0 clusters
Asked to drop no genes or cells
Creating new clusterization: START
Elaborating Reduced dimensionality Data Matrix - START
Elaborating COEX Eigen Vectors - START
Elaborating COEX Eigen Vectors - DONE
Total calculations elapsed time: 1.34124207496643
Elaborating Reduced dimensionality Data Matrix - DONE
Computing nearest neighbor graph
Computing SNN
Modularity Optimizer version 1.3.0 by Ludo Waltman and Nees Jan van Eck
Number of nodes: 1000
Number of edges: 36652
Running Louvain algorithm with multilevel refinement...
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Maximum modularity in 10 random starts: 0.3743
Number of communities: 4
Elapsed time: 0 seconds
Used resolution for Seurat clusterization is: 1.3
Total calculations elapsed time: 1.70390200614929
Creating new clusterization: DONE
Creating PDF UMAP in file: /var/folders/r0/l4fjk6cj5xj0j3brt4bplpl40000gt/T//RtmpOjTfuA/test/reclustering/pdf_umap_1.pdf
UMAP plot: START
Calculating UMAP: START
19:01:42 UMAP embedding parameters a = 0.9922 b = 1.112
19:01:42 Read 1000 rows and found 65 numeric columns
19:01:42 Using Annoy for neighbor search, n_neighbors = 30
19:01:42 Building Annoy index with metric = cosine, n_trees = 50
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
19:01:42 Writing NN index file to temp file /var/folders/r0/l4fjk6cj5xj0j3brt4bplpl40000gt/T//RtmpOjTfuA/file11e42274d13cc
19:01:42 Searching Annoy index using 1 thread, search_k = 3000
19:01:42 Annoy recall = 100%
19:01:43 Commencing smooth kNN distance calibration using 1 thread with target n_neighbors = 30
19:01:44 Initializing from normalized Laplacian + noise (using RSpectra)
19:01:44 Commencing optimization for 500 epochs, with 39044 positive edges
19:01:44 Using rng type: pcg
Using method 'umap'
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
19:01:45 Optimization finished
Calculating UMAP: DONE
Total calculations elapsed time: 2.77653002738953
UMAP plot: DONE
UMAP plot: START
Calculating UMAP: START
19:01:45 UMAP embedding parameters a = 0.9922 b = 1.112
19:01:45 Read 1000 rows and found 65 numeric columns
19:01:45 Using Annoy for neighbor search, n_neighbors = 30
19:01:45 Building Annoy index with metric = cosine, n_trees = 50
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
19:01:45 Writing NN index file to temp file /var/folders/r0/l4fjk6cj5xj0j3brt4bplpl40000gt/T//RtmpOjTfuA/file11e4247bf447b
19:01:45 Searching Annoy index using 1 thread, search_k = 3000
19:01:45 Annoy recall = 100%
19:01:46 Commencing smooth kNN distance calibration using 1 thread with target n_neighbors = 30
19:01:46 Initializing from normalized Laplacian + noise (using RSpectra)
19:01:46 Commencing optimization for 500 epochs, with 39044 positive edges
19:01:46 Using rng type: pcg
Using method 'umap'
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
19:01:48 Optimization finished
Calculating UMAP: DONE
Total calculations elapsed time: 2.70756077766418
UMAP plot: DONE
* checking uniformity of cluster '0' of 4 clusters
Asked to drop 0 genes and 687 cells
COTAN dataset analysis: START
Asked to drop 43 genes and 0 cells
Genes/cells selection done: dropped [43] genes and [0] cells
Working on [557] genes and [313] cells
Dataset cleaning elapsed time: 0.390970945358276
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 11 iterations
Total calculations elapsed time: 0.790280103683472
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.126565269702225 | max: 788.372048308529 | % negative: 38.5996409335727
Model parameter estimation elapsed time: 1.22108602523804
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 1.35350704193115
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00321412086486816
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0139849185943604
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.397332906723022
Total calculations elapsed time: 1.7680389881134
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 2.16370701789856
Dataset analysis elapsed time: 3.77576398849487
COTAN dataset analysis: DONE
Checking uniformity for the cluster '01_0000' with 313 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.013667106628418
Calculate `GDI`: DONE
Total calculations elapsed time: 0.413380861282349
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.00988483428955078
Clean plots: DONE
GDI plot
Removed 0 low GDI genes (such as the fully-expressed) in GDI plot
Cluster 01_0000, with size 313, is uniform
Cluster 01_0000's shift to uniformity: -0.0175178017152766
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.397, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.0412926391382406, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 1.37948219828472, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.407, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.0323159784560144, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 1.43089123341067, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.5, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0.00179533213644524, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 1.4438361365159, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.5, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 1, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 1.47612588512221, isUniform = TRUE, clusterSize = 313
cluster 01_0000 is uniform
* checking uniformity of cluster '1' of 4 clusters
Asked to drop 0 genes and 743 cells
COTAN dataset analysis: START
Asked to drop 51 genes and 0 cells
Genes/cells selection done: dropped [51] genes and [0] cells
Working on [549] genes and [257] cells
Dataset cleaning elapsed time: 0.399142026901245
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 10 iterations
Total calculations elapsed time: 0.878227949142456
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.112503099391263 | max: 646.681464270838 | % negative: 40.8014571948998
Model parameter estimation elapsed time: 1.29112982749939
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 1.31546902656555
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00202679634094238
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0106320381164551
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.390589952468872
Total calculations elapsed time: 1.71871781349182
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 2.11663007736206
Dataset analysis elapsed time: 3.8069019317627
COTAN dataset analysis: DONE
Checking uniformity for the cluster '01_0001' with 257 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.012174129486084
Calculate `GDI`: DONE
Total calculations elapsed time: 0.408334016799927
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.0108530521392822
Clean plots: DONE
GDI plot
Removed 1 low GDI genes (such as the fully-expressed) in GDI plot
Cluster 01_0001, with size 257, is uniform
Cluster 01_0001's shift to uniformity: -0.0466523594845982
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.397, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.00910746812386157, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 1.3503476405154, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.407, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.00728597449908925, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 1.37278730407693, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.5, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 1.3866416314687, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.5, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 0, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 1.45240567481124, isUniform = TRUE, clusterSize = 257
cluster 01_0001 is uniform
* checking uniformity of cluster '2' of 4 clusters
Asked to drop 0 genes and 758 cells
COTAN dataset analysis: START
Asked to drop 77 genes and 0 cells
Genes/cells selection done: dropped [77] genes and [0] cells
Working on [523] genes and [242] cells
Dataset cleaning elapsed time: 0.410812854766846
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 0.825237989425659
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.166254045792573 | max: 224.924342782861 | % negative: 42.6386233269598
Model parameter estimation elapsed time: 1.19006299972534
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 1.28023409843445
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00319480895996094
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0107259750366211
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.421094179153442
Total calculations elapsed time: 1.71524906158447
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 2.12636113166809
Dataset analysis elapsed time: 3.72723698616028
COTAN dataset analysis: DONE
Checking uniformity for the cluster '01_0002' with 242 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0122289657592773
Calculate `GDI`: DONE
Total calculations elapsed time: 0.445746898651123
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.0102999210357666
Clean plots: DONE
GDI plot
Removed 2 low GDI genes (such as the fully-expressed) in GDI plot
Cluster 01_0002, with size 242, is uniform
Cluster 01_0002's shift to uniformity: -0.0473527936300249
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.397, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.00764818355640535, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 1.34964720636998, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.407, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.00764818355640535, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 1.37472946305404, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.5, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 1.38771313919655, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.5, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 0, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 1.43097703442027, isUniform = TRUE, clusterSize = 242
cluster 01_0002 is uniform
* checking uniformity of cluster '3' of 4 clusters
Asked to drop 0 genes and 812 cells
COTAN dataset analysis: START
Asked to drop 79 genes and 0 cells
Genes/cells selection done: dropped [79] genes and [0] cells
Working on [521] genes and [188] cells
Dataset cleaning elapsed time: 0.380116939544678
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 6 iterations
Total calculations elapsed time: 0.820494890213013
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.210007411487223 | max: 67.8701314818728 | % negative: 45.6813819577735
Model parameter estimation elapsed time: 1.24161601066589
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 1.24043202400208
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00193691253662109
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.00937414169311523
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.386291980743408
Total calculations elapsed time: 1.63803505897522
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 2.0409369468689
Dataset analysis elapsed time: 3.66266989707947
COTAN dataset analysis: DONE
Checking uniformity for the cluster '01_0003' with 188 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0119209289550781
Calculate `GDI`: DONE
Total calculations elapsed time: 0.399200916290283
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.00985503196716309
Clean plots: DONE
GDI plot
Removed 4 low GDI genes (such as the fully-expressed) in GDI plot
Cluster 01_0003, with size 188, is uniform
Cluster 01_0003's shift to uniformity: -0.0672912272436468
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.397, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.00383877159309021, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 1.32970877275635, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.407, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.00191938579654511, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 1.35752445041519, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.5, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 1.37495297633951, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.5, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 0, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 1.40148843025229, isUniform = TRUE, clusterSize = 188
cluster 01_0003 is uniform
Found 4 uniform and 0 non-uniform clusters
Stopping: too few cells left to cluster
Unclustered cell left: 0
The final raw clusterization contains [ 4 ] different clusters: 01_0000, 01_0001, 01_0002, 01_0003
Differential Expression Analysis - START
* DEA on cluster '1' with 313 cells
* DEA on cluster '2' with 257 cells
* DEA on cluster '3' with 242 cells
* DEA on cluster '4' with 188 cells
Total calculations elapsed time: 0.0129139423370361
Differential Expression Analysis - DONE
Applied reordering to clusterization is:
1 -> 3, 2 -> 1, 3 -> 2, 4 -> 4
Total calculations elapsed time: 30.5464041233063
Creating cells' uniform clustering: DONE
Applied reordering to clusterization is:
1 -> 1, 2 -> 2, 3 -> 3, 4 -> 4
Asked to drop 0 genes and 812 cells
COTAN dataset analysis: START
Asked to drop 79 genes and 0 cells
Genes/cells selection done: dropped [79] genes and [0] cells
Working on [521] genes and [188] cells
Dataset cleaning elapsed time: 0.384645223617554
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 6 iterations
Total calculations elapsed time: 0.837745904922485
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.210007411487223 | max: 67.8701314818728 | % negative: 45.6813819577735
Model parameter estimation elapsed time: 1.23979997634888
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 1.25551104545593
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00214505195617676
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.00942587852478027
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.417762041091919
Total calculations elapsed time: 1.68484401702881
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 2.10459685325623
Dataset analysis elapsed time: 3.72904205322266
COTAN dataset analysis: DONE
Checking uniformity for the cluster 'Cluster_4' with 188 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0121011734008789
Calculate `GDI`: DONE
Total calculations elapsed time: 0.43130612373352
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.010051965713501
Clean plots: DONE
GDI plot
Removed 4 low GDI genes (such as the fully-expressed) in GDI plot
Cluster Cluster_4, with size 188, is uniform
Cluster Cluster_4's shift to uniformity: -0.0672912272436468
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.397, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.00383877159309021, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 1.32970877275635, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.407, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.00191938579654511, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 1.35752445041519, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.5, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 1.37495297633951, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.5, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 0, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 1.40148843025229, isUniform = TRUE, clusterSize = 188
Differential Expression Analysis - START
* DEA on cluster '-1' with 50 cells
* DEA on cluster '1' with 257 cells
* DEA on cluster '2' with 242 cells
* DEA on cluster '3' with 280 cells
* DEA on cluster '4' with 171 cells
Total calculations elapsed time: 0.012728214263916
Differential Expression Analysis - DONE
Applied reordering to clusterization is:
1 -> 4, 2 -> 3, 3 -> 2, 4 -> 1, -1 -> -1
Applied reordering to clusterization is:
1 -> 1, 2 -> 2, 3 -> 3, 4 -> 4, -1 -> -1
Creating cells' uniform clustering: START
In iteration 1 the number of cells to re-cluster is 1000 cells belonging to 0 clusters
Asked to drop no genes or cells
Creating new clusterization: START
Elaborating Reduced dimensionality Data Matrix - START
Running genes' selection: START
Normalizing layer: counts
Performing log-normalization
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Finding variable features for layer counts
Calculating gene variances
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Calculating feature variances of standardized and clipped values
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Selected 600 genes using HVG_Seurat selector
Running genes' selection: DONE
Elaborating PCA - START
Elaborating PCA - DONE
Total calculations elapsed time: 1.53569984436035
Elaborating Reduced dimensionality Data Matrix - DONE
Computing nearest neighbor graph
Computing SNN
Modularity Optimizer version 1.3.0 by Ludo Waltman and Nees Jan van Eck
Number of nodes: 1000
Number of edges: 67288
Running Louvain algorithm with multilevel refinement...
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Maximum modularity in 10 random starts: 0.3650
Number of communities: 5
Elapsed time: 0 seconds
Used resolution for Seurat clusterization is: 1.3
Total calculations elapsed time: 1.9122359752655
Creating new clusterization: DONE
Using passed in clusterization
Creating PDF UMAP in file: /var/folders/r0/l4fjk6cj5xj0j3brt4bplpl40000gt/T//RtmpOjTfuA/test/reclustering/pdf_umap_1.pdf
UMAP plot: START
Calculating UMAP: START
19:02:19 UMAP embedding parameters a = 0.9922 b = 1.112
19:02:19 Read 1000 rows and found 40 numeric columns
19:02:19 Using Annoy for neighbor search, n_neighbors = 30
19:02:19 Building Annoy index with metric = cosine, n_trees = 50
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
19:02:19 Writing NN index file to temp file /var/folders/r0/l4fjk6cj5xj0j3brt4bplpl40000gt/T//RtmpOjTfuA/file11e4273f4525d
19:02:19 Searching Annoy index using 1 thread, search_k = 3000
19:02:19 Annoy recall = 100%
19:02:19 Commencing smooth kNN distance calibration using 1 thread with target n_neighbors = 30
19:02:20 Found 2 connected components, falling back to 'spca' initialization with init_sdev = 1
19:02:20 Using 'irlba' for PCA
19:02:20 PCA: 2 components explained 36.15% variance
19:02:20 Scaling init to sdev = 1
19:02:20 Commencing optimization for 500 epochs, with 41630 positive edges
19:02:20 Using rng type: pcg
Using method 'umap'
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
19:02:21 Optimization finished
Calculating UMAP: DONE
Total calculations elapsed time: 2.7055811882019
UMAP plot: DONE
UMAP plot: START
Calculating UMAP: START
19:02:21 UMAP embedding parameters a = 0.9922 b = 1.112
19:02:21 Read 1000 rows and found 40 numeric columns
19:02:21 Using Annoy for neighbor search, n_neighbors = 30
19:02:21 Building Annoy index with metric = cosine, n_trees = 50
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
19:02:21 Writing NN index file to temp file /var/folders/r0/l4fjk6cj5xj0j3brt4bplpl40000gt/T//RtmpOjTfuA/file11e423ca937b7
19:02:21 Searching Annoy index using 1 thread, search_k = 3000
19:02:21 Annoy recall = 100%
19:02:22 Commencing smooth kNN distance calibration using 1 thread with target n_neighbors = 30
19:02:23 Found 2 connected components, falling back to 'spca' initialization with init_sdev = 1
19:02:23 Using 'irlba' for PCA
19:02:23 PCA: 2 components explained 36.15% variance
19:02:23 Scaling init to sdev = 1
19:02:23 Commencing optimization for 500 epochs, with 41630 positive edges
19:02:23 Using rng type: pcg
Using method 'umap'
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
19:02:24 Optimization finished
Calculating UMAP: DONE
Total calculations elapsed time: 2.82159090042114
UMAP plot: DONE
* checking uniformity of cluster '1' of 2 clusters
Asked to drop 0 genes and 500 cells
COTAN dataset analysis: START
Asked to drop 38 genes and 0 cells
Genes/cells selection done: dropped [38] genes and [0] cells
Working on [562] genes and [500] cells
Dataset cleaning elapsed time: 0.414382934570312
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 0.845475912094116
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.108871643378045 | max: 295.971778839086 | % negative: 35.0533807829181
Model parameter estimation elapsed time: 1.26273488998413
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 1.42870497703552
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00212979316711426
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0148551464080811
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.407531976699829
Total calculations elapsed time: 1.85322189331055
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 2.28365111351013
Dataset analysis elapsed time: 3.96076893806458
COTAN dataset analysis: DONE
Checking uniformity for the cluster '01_0001' with 500 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0141620635986328
Calculate `GDI`: DONE
Total calculations elapsed time: 0.393563985824585
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.0106031894683838
Clean plots: DONE
GDI plot
Removed 2 low GDI genes (such as the fully-expressed) in GDI plot
Cluster 01_0001, with size 500, is uniform
Cluster 01_0001's shift to uniformity: -0.0417301990665557
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.397, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.0124555160142349, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 1.35526980093344, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.407, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.00889679715302491, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 1.38536328181507, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.5, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 1.40346106115487, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.5, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 0, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 1.42565794715046, isUniform = TRUE, clusterSize = 500
cluster 01_0001 is uniform
* checking uniformity of cluster '2' of 2 clusters
Asked to drop 0 genes and 500 cells
COTAN dataset analysis: START
Asked to drop 44 genes and 0 cells
Genes/cells selection done: dropped [44] genes and [0] cells
Working on [556] genes and [500] cells
Dataset cleaning elapsed time: 0.404936790466309
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 0.831051826477051
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0636486786621688 | max: 141.389145035675 | % negative: 36.1510791366906
Model parameter estimation elapsed time: 1.24894213676453
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 1.42001605033875
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00392794609069824
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0169470310211182
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.411999940872192
Total calculations elapsed time: 1.85289096832275
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 2.26560497283936
Dataset analysis elapsed time: 3.91948390007019
COTAN dataset analysis: DONE
Checking uniformity for the cluster '01_0002' with 500 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0139341354370117
Calculate `GDI`: DONE
Total calculations elapsed time: 0.424354076385498
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.010645866394043
Clean plots: DONE
GDI plot
Removed 2 low GDI genes (such as the fully-expressed) in GDI plot
Cluster 01_0002, with size 500, is uniform
Cluster 01_0002's shift to uniformity: -0.0413872276843466
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.397, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.00719424460431655, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 1.35561277231565, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.407, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.00359712230215827, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 1.37204026755188, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.5, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 1.38757136821582, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.5, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 0, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 1.40876953414107, isUniform = TRUE, clusterSize = 500
cluster 01_0002 is uniform
Found 2 uniform and 0 non-uniform clusters
Stopping: too few cells left to cluster
Unclustered cell left: 0
The final raw clusterization contains [ 2 ] different clusters: 01_0001, 01_0002
Differential Expression Analysis - START
* DEA on cluster '1' with 500 cells
* DEA on cluster '2' with 500 cells
Total calculations elapsed time: 0.0109009742736816
Differential Expression Analysis - DONE
Applied reordering to clusterization is:
1 -> 1, 2 -> 2
Total calculations elapsed time: 19.7116250991821
Creating cells' uniform clustering: DONE
findClustersMarkers - START
Log Fold Change Analysis - START
* Analysis of cluster: '1'
* Analysis of cluster: '2'
* Analysis of cluster: '3'
* Analysis of cluster: '4'
Total calculations elapsed time: 1.5921630859375
Log Fold Change Analysis - DONE
Total calculations elapsed time: 1.59596109390259
findClustersMarkers - DONE
findClustersMarkers - START
Log Fold Change Analysis - START
* Analysis of cluster: '1'
* Analysis of cluster: '2'
* Analysis of cluster: '3'
* Analysis of cluster: '4'
Total calculations elapsed time: 1.60718011856079
Log Fold Change Analysis - DONE
Total calculations elapsed time: 1.61058497428894
findClustersMarkers - DONE
findClustersMarkers - START
Differential Expression Analysis - START
* DEA on cluster '1' with 257 cells
* DEA on cluster '2' with 242 cells
* DEA on cluster '3' with 313 cells
* DEA on cluster '4' with 188 cells
Total calculations elapsed time: 0.0101020336151123
Differential Expression Analysis - DONE
Log Fold Change Analysis - START
* Analysis of cluster: '1'
* Analysis of cluster: '2'
* Analysis of cluster: '3'
* Analysis of cluster: '4'
Total calculations elapsed time: 1.5614640712738
Log Fold Change Analysis - DONE
Total calculations elapsed time: 1.57452201843262
findClustersMarkers - DONE
Tested cluster: 1Asked to drop 0 genes and 743 cells
COTAN dataset analysis: START
Asked to drop 51 genes and 0 cells
Genes/cells selection done: dropped [51] genes and [0] cells
Working on [549] genes and [257] cells
Dataset cleaning elapsed time: 0.405158996582031
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 10 iterations
Total calculations elapsed time: 0.838545083999634
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.112503099391263 | max: 646.681464270838 | % negative: 40.8014571948998
Model parameter estimation elapsed time: 1.24125003814697
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 1.27995896339417
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00197601318359375
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0108838081359863
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.410620212554932
Total calculations elapsed time: 1.70343899726868
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 2.13053202629089
Dataset analysis elapsed time: 3.7769410610199
COTAN dataset analysis: DONE
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0132238864898682
Calculate `GDI`: DONE
Total calculations elapsed time: 0.426488161087036
Calculate GDI dataframe: DONE
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [10] genes and [20] cells
Initializing `COTAN` meta-data
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 0.869162082672119
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916524 | max: 462.908586418992 | % negative: 17.3333333333333
Initializing `COTAN` meta-data
COTAN dataset analysis: START
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Dataset cleaning elapsed time: 0.440180063247681
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 0.866115808486938
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916524 | max: 462.908586418992 | % negative: 17.3333333333333
Model parameter estimation elapsed time: 1.2635989189148
COTAN genes' COEX estimation not requested
Only genes' COEX elapsed time: 0.409667015075684
Dataset analysis elapsed time: 2.11344599723816
COTAN dataset analysis: DONE
Normalizing layer: counts
Performing log-normalization
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Finding variable features for layer counts
Calculating gene variances
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Calculating feature variances of standardized and clipped values
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Centering and scaling data matrix
|
| | 0%
|
|======================================================================| 100%
PC_ 1
Positive: g-000397, g-000525, g-000460, g-000458, g-000535, g-000217, g-000194, g-000497, g-000432, g-000383
g-000318, g-000486, g-000464, g-000588, g-000549, g-000368, g-000252, g-000151, g-000209, g-000538
g-000325, g-000514, g-000524, g-000244, g-000320, g-000201, g-000499, g-000309, g-000290, g-000483
Negative: g-000415, g-000506, g-000496, g-000579, g-000572, g-000421, g-000455, g-000328, g-000178, g-000567
g-000405, g-000296, g-000387, g-000501, g-000493, g-000481, g-000343, g-000528, g-000551, g-000414
g-000367, g-000594, g-000159, g-000517, g-000574, g-000229, g-000222, g-000533, g-000243, g-000306
PC_ 2
Positive: g-000141, g-000093, g-000089, g-000033, g-000123, g-000557, g-000330, g-000156, g-000142, g-000095
g-000061, g-000235, g-000032, g-000186, g-000056, g-000259, g-000027, g-000041, g-000333, g-000386
g-000009, g-000395, g-000048, g-000116, g-000340, g-000418, g-000035, g-000332, g-000086, g-000040
Negative: g-000088, g-000158, g-000255, g-000115, g-000054, g-000472, g-000554, g-000391, g-000253, g-000226
g-000051, g-000147, g-000541, g-000077, g-000224, g-000194, g-000290, g-000293, g-000313, g-000118
g-000121, g-000220, g-000467, g-000500, g-000341, g-000039, g-000091, g-000249, g-000426, g-000288
PC_ 3
Positive: g-000096, g-000575, g-000370, g-000337, g-000319, g-000364, g-000308, g-000293, g-000147, g-000307
g-000038, g-000492, g-000541, g-000185, g-000008, g-000482, g-000562, g-000097, g-000222, g-000084
g-000141, g-000377, g-000224, g-000223, g-000136, g-000434, g-000277, g-000426, g-000139, g-000093
Negative: g-000126, g-000083, g-000086, g-000117, g-000130, g-000010, g-000498, g-000333, g-000047, g-000179
g-000340, g-000035, g-000531, g-000140, g-000527, g-000049, g-000316, g-000031, g-000014, g-000073
g-000218, g-000445, g-000129, g-000175, g-000105, g-000581, g-000404, g-000025, g-000266, g-000354
PC_ 4
Positive: g-000006, g-000043, g-000462, g-000279, g-000180, g-000576, g-000087, g-000584, g-000498, g-000333
g-000189, g-000088, g-000451, g-000059, g-000135, g-000281, g-000106, g-000429, g-000316, g-000578
g-000303, g-000031, g-000581, g-000026, g-000122, g-000561, g-000546, g-000164, g-000353, g-000300
Negative: g-000072, g-000012, g-000129, g-000052, g-000097, g-000262, g-000080, g-000056, g-000025, g-000092
g-000354, g-000334, g-000423, g-000228, g-000002, g-000010, g-000086, g-000147, g-000185, g-000172
g-000124, g-000009, g-000077, g-000476, g-000126, g-000145, g-000065, g-000268, g-000152, g-000348
PC_ 5
Positive: g-000105, g-000037, g-000110, g-000054, g-000090, g-000389, g-000022, g-000578, g-000289, g-000147
g-000547, g-000011, g-000477, g-000433, g-000200, g-000348, g-000404, g-000003, g-000250, g-000109
g-000402, g-000241, g-000595, g-000341, g-000560, g-000385, g-000413, g-000352, g-000573, g-000265
Negative: g-000051, g-000150, g-000088, g-000476, g-000344, g-000116, g-000428, g-000012, g-000523, g-000394
g-000101, g-000127, g-000069, g-000214, g-000049, g-000357, g-000075, g-000081, g-000576, g-000342
g-000439, g-000018, g-000070, g-000079, g-000015, g-000550, g-000600, g-000247, g-000218, g-000331
Computing nearest neighbor graph
Computing SNN
Modularity Optimizer version 1.3.0 by Ludo Waltman and Nees Jan van Eck
Number of nodes: 1000
Number of edges: 68208
Running Louvain algorithm with multilevel refinement...
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Maximum modularity in 10 random starts: 0.6000
Number of communities: 3
Elapsed time: 0 seconds
Clusterizations found: RNA_snn_res.0.8, seurat_clusters
Conditions found: orig.ident
COTAN dataset analysis: START
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Dataset cleaning elapsed time: 0.430334806442261
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 0.882290124893188
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916524 | max: 462.908586418992 | % negative: 17.3333333333333
Model parameter estimation elapsed time: 1.29760718345642
COTAN genes' COEX estimation not requested
Only genes' COEX elapsed time: 0.412432909011841
Dataset analysis elapsed time: 2.14037489891052
COTAN dataset analysis: DONE
COTAN dataset analysis: START
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Dataset cleaning elapsed time: 0.43038010597229
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 0.876015901565552
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916524 | max: 462.908586418992 | % negative: 17.3333333333333
Model parameter estimation elapsed time: 1.29753303527832
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 1.67445802688599
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00394701957702637
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0263819694519043
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.420130014419556
Total calculations elapsed time: 2.12491703033447
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 2.54969882965088
Dataset analysis elapsed time: 4.27761197090149
COTAN dataset analysis: DONE
Calculating gene co-expression space - START
Using S
Calculating S: START
Calculating S: DONE
calculating PValues: START
Get p-values on a set of genes on columns and genome wide on rows
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.00242090225219727
calculating PValues: DONE
Number of selected secondary markers: 6
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.000840902328491211
Calculate `GDI`: DONE
Number of columns (V set - secondary markers): 6
Number of rows (U set): 60
Total calculations elapsed time: 0.400391101837158
Calculating gene co-expression space - DONE
Calculating gene co-expression space - START
Using S
Calculating S: START
Calculating S: DONE
calculating PValues: START
Get p-values on a set of genes on columns and genome wide on rows
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.00277614593505859
calculating PValues: DONE
Number of selected secondary markers: 98
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.00544595718383789
Calculate `GDI`: DONE
Number of columns (V set - secondary markers): 98
Number of rows (U set): 60
Total calculations elapsed time: 0.445088863372803
Calculating gene co-expression space - DONE
Establishing gene clusters - START
Calculating gene co-expression space - START
Using S
Calculating S: START
Calculating S: DONE
calculating PValues: START
Get p-values on a set of genes on columns and genome wide on rows
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.00256991386413574
calculating PValues: DONE
Number of selected secondary markers: 98
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.00307488441467285
Calculate `GDI`: DONE
Number of columns (V set - secondary markers): 98
Number of rows (U set): 60
Total calculations elapsed time: 0.438446044921875
Calculating gene co-expression space - DONE
Total calculations elapsed time: 0.463124990463257
Establishing gene clusters - DONE
Initializing `COTAN` meta-data
COTAN dataset analysis: START
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Dataset cleaning elapsed time: 0.418092012405396
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 0.85793399810791
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916524 | max: 462.908586418992 | % negative: 17.3333333333333
Model parameter estimation elapsed time: 1.27681589126587
COTAN genes' COEX estimation not requested
Only genes' COEX elapsed time: 0.428538084030151
Dataset analysis elapsed time: 2.12344598770142
COTAN dataset analysis: DONE
Differential Expression Analysis - START
* DEA on cluster '1' with 257 cells
* DEA on cluster '2' with 242 cells
* DEA on cluster '3' with 313 cells
* DEA on cluster '4' with 188 cells
Total calculations elapsed time: 0.0106050968170166
Differential Expression Analysis - DONE
Log Fold Change Analysis - START
* Analysis of cluster: '1'
* Analysis of cluster: '2'
* Analysis of cluster: '3'
* Analysis of cluster: '4'
Total calculations elapsed time: 1.67508482933044
Log Fold Change Analysis - DONE
clustersDeltaExpression - START
Handling cluster '1' with mean UDE 1.10997640736885
Handling cluster '2' with mean UDE 1.00770245700749
Handling cluster '3' with mean UDE 0.95940682189354
Handling cluster '4' with mean UDE 0.907328369455933
clustersDeltaExpression - DONE
In group G1 there are 3 detected over 3 genes
In group G2 there are 2 detected over 3 genes
In group G3 there are 5 detected over 5 genes
Merging cells' uniform clustering: START
The merge algorithm will use 2 passes
Start merging nearest clusters - the main threshold is: 1.297
Start merging nearest clusters: iteration 1
Differential Expression Analysis - START
* DEA on cluster '1' with 257 cells
* DEA on cluster '2' with 242 cells
* DEA on cluster '3' with 313 cells
* DEA on cluster '4' with 188 cells
Total calculations elapsed time: 0.0106868743896484
Differential Expression Analysis - DONE
Updating check results for the 0 already tested pairs to align to new checker
1 new clusters pairs to be tested for merging:
c("1", "2")
*1_2-merge
Asked to drop 0 genes and 501 cells
COTAN dataset analysis: START
Asked to drop 16 genes and 0 cells
Genes/cells selection done: dropped [16] genes and [0] cells
Working on [584] genes and [499] cells
Dataset cleaning elapsed time: 0.409927845001221
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 10 iterations
Total calculations elapsed time: 0.840687036514282
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0608154544840047 | max: 1260.06995351592 | % negative: 35.6164383561644
Model parameter estimation elapsed time: 1.25177407264709
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 1.51736283302307
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00409913063049316
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0172019004821777
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.425481081008911
Total calculations elapsed time: 1.96414494514465
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 2.3860969543457
Dataset analysis elapsed time: 4.04779887199402
COTAN dataset analysis: DONE
Checking uniformity for the cluster '1_2-merge' with 499 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0156769752502441
Calculate `GDI`: DONE
Total calculations elapsed time: 0.43456506729126
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.00989699363708496
Clean plots: DONE
GDI plot
Removed 1 low GDI genes (such as the fully-expressed) in GDI plot
Cluster 1_2-merge, with size 499, is not uniform
Cluster 1_2-merge's shift to uniformity: 0.0566581136434186
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.297, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.178082191780822, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 1.35365811364342, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.307, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.148972602739726, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 1.37149326865972, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.4, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0.00513698630136986, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 1.38256306292778, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.4, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 3, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 1.42111642638126, isUniform = FALSE, clusterSize = 499
Clusters 1 and 2 cannot be merged
Finished the first batch - no merges were executed
Loop calculations elapsed time: 6.39219999313354
Start merging nearest clusters: iteration 2
Differential Expression Analysis - START
* DEA on cluster '1' with 257 cells
* DEA on cluster '2' with 242 cells
* DEA on cluster '3' with 313 cells
* DEA on cluster '4' with 188 cells
Total calculations elapsed time: 0.011829137802124
Differential Expression Analysis - DONE
Updating check results for the 1 already tested pairs to align to new checker
1 new clusters pairs to be tested for merging:
c("3", "4")
*3_4-merge
Asked to drop 0 genes and 499 cells
COTAN dataset analysis: START
Asked to drop 37 genes and 0 cells
Genes/cells selection done: dropped [37] genes and [0] cells
Working on [563] genes and [501] cells
Dataset cleaning elapsed time: 0.425228834152222
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 11 iterations
Total calculations elapsed time: 0.842849016189575
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.107568326617881 | max: 698.639334552755 | % negative: 32.1492007104796
Model parameter estimation elapsed time: 1.26327919960022
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 1.4261372089386
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.0028688907623291
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.016603946685791
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.40958309173584
Total calculations elapsed time: 1.85519313812256
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 2.28260588645935
Dataset analysis elapsed time: 3.97111392021179
COTAN dataset analysis: DONE
Checking uniformity for the cluster '3_4-merge' with 501 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0140020847320557
Calculate `GDI`: DONE
Total calculations elapsed time: 0.413883924484253
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.0102469921112061
Clean plots: DONE
GDI plot
Removed 0 low GDI genes (such as the fully-expressed) in GDI plot
Cluster 3_4-merge, with size 501, is not uniform
Cluster 3_4-merge's shift to uniformity: 0.0813107504724644
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.297, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.259325044404973, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 1.37831075047246, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.307, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.216696269982238, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 1.41473792188165, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.4, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0.0301953818827709, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 1.43341610223173, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.4, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 17, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 1.4617394878777, isUniform = FALSE, clusterSize = 501
Clusters 3 and 4 cannot be merged
No clusters will be merged
None of the remaining tested cluster pairs could be merged
Executed all merges for threshold 1.297 out of 2 checks
Start merging nearest clusters - the main threshold is: 1.397
Start merging nearest clusters: iteration 3
Differential Expression Analysis - START
* DEA on cluster '1' with 257 cells
* DEA on cluster '2' with 242 cells
* DEA on cluster '3' with 313 cells
* DEA on cluster '4' with 188 cells
Total calculations elapsed time: 0.0114409923553467
Differential Expression Analysis - DONE
Updating check results for the 2 already tested pairs to align to new checker
1 new clusters pairs to be tested for merging:
c("2", "4")
*2_4-merge
Asked to drop 0 genes and 570 cells
COTAN dataset analysis: START
Asked to drop 9 genes and 0 cells
Genes/cells selection done: dropped [9] genes and [0] cells
Working on [591] genes and [430] cells
Dataset cleaning elapsed time: 0.424494028091431
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 0.844804048538208
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0739592351622374 | max: 400.051960722886 | % negative: 25.7191201353638
Model parameter estimation elapsed time: 1.27405405044556
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 1.41387701034546
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00372099876403809
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0174009799957275
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.43626594543457
Total calculations elapsed time: 1.8712649345398
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 2.31972312927246
Dataset analysis elapsed time: 4.01827120780945
COTAN dataset analysis: DONE
Checking uniformity for the cluster '2_4-merge' with 430 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0156948566436768
Calculate `GDI`: DONE
Total calculations elapsed time: 0.484388113021851
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.0103051662445068
Clean plots: DONE
GDI plot
Removed 0 low GDI genes (such as the fully-expressed) in GDI plot
Cluster 2_4-merge, with size 430, is not uniform
Cluster 2_4-merge's shift to uniformity: 3.07228472969514
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.397, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.583756345177665, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 3.7954982715656, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.407, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.576988155668359, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 4.08354952912925, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.5, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0.524534686971235, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 4.42722016730736, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.5, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 310, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 4.57228472969514, isUniform = FALSE, clusterSize = 430
Clusters 2 and 4 cannot be merged
Clusters 1 and 2 will be merged
Clusters 4 and 3 will be merged
Executed 2 merges
Loop calculations elapsed time: 6.60500693321228
Start merging nearest clusters: iteration 4
Differential Expression Analysis - START
* DEA on cluster '1_2-merge' with 499 cells
* DEA on cluster '3_4-merge' with 501 cells
Total calculations elapsed time: 0.0105588436126709
Differential Expression Analysis - DONE
Updating check results for the 3 already tested pairs to align to new checker
1 new clusters pairs to be tested for merging:
c("1_2-merge", "3_4-merge")
*1_2-merge_3_4-merge-merge
Asked to drop no genes or cells
COTAN dataset analysis: START
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Dataset cleaning elapsed time: 0.439043998718262
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 0.923249006271362
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916524 | max: 462.908586418992 | % negative: 17.3333333333333
Model parameter estimation elapsed time: 1.39589810371399
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 1.74571394920349
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00330901145935059
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0262830257415771
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.45748496055603
Total calculations elapsed time: 2.23279094696045
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 2.66462302207947
Dataset analysis elapsed time: 4.49956512451172
COTAN dataset analysis: DONE
Checking uniformity for the cluster '1_2-merge_3_4-merge-merge' with 1000 cells
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0158951282501221
Calculate `GDI`: DONE
Total calculations elapsed time: 0.463631868362427
Calculate GDI dataframe: DONE
Clean plots: START
Total calculations elapsed time: 0.0115211009979248
Clean plots: DONE
GDI plot
Removed 0 low GDI genes (such as the fully-expressed) in GDI plot
Cluster 1_2-merge_3_4-merge-merge, with size 1000, is not uniform
Cluster 1_2-merge_3_4-merge-merge's shift to uniformity: 3.86988385120409
class = AdvancedGDIUniformityCheck, firstCheck.isCheckAbove = FALSE, firstCheck.GDIThreshold = 1.397, firstCheck.maxRatioBeyond = 0.05, firstCheck.maxRankBeyond = 0, firstCheck.fractionBeyond = 0.69, firstCheck.thresholdRank = 0, firstCheck.quantileAtRatio = 4.54596809454193, firstCheck.quantileAtRank = NaN, secondCheck.isCheckAbove = TRUE, secondCheck.GDIThreshold = 1.407, secondCheck.maxRatioBeyond = 0.02, secondCheck.maxRankBeyond = 0, secondCheck.fractionBeyond = 0.678333333333333, secondCheck.thresholdRank = 0, secondCheck.quantileAtRatio = 4.93144728766684, secondCheck.quantileAtRank = NaN, thirdCheck.isCheckAbove = FALSE, thirdCheck.GDIThreshold = 1.5, thirdCheck.maxRatioBeyond = 0.01, thirdCheck.maxRankBeyond = 0, thirdCheck.fractionBeyond = 0.593333333333333, thirdCheck.thresholdRank = 0, thirdCheck.quantileAtRatio = 5.2532296852478, thirdCheck.quantileAtRank = NaN, fourthCheck.isCheckAbove = FALSE, fourthCheck.GDIThreshold = 1.5, fourthCheck.maxRatioBeyond = NaN, fourthCheck.maxRankBeyond = 2, fourthCheck.fractionBeyond = NaN, fourthCheck.thresholdRank = 356, fourthCheck.quantileAtRatio = NaN, fourthCheck.quantileAtRank = 5.36988385120409, isUniform = FALSE, clusterSize = 1000
Clusters 1_2-merge and 3_4-merge cannot be merged
No clusters will be merged
None of the remaining tested cluster pairs could be merged
Executed all merges for threshold 1.397 out of 4 checks
The final merged clusterization contains [2] different clusters: 1_2-merge, 3_4-merge
Differential Expression Analysis - START
* DEA on cluster '1' with 499 cells
* DEA on cluster '2' with 501 cells
Total calculations elapsed time: 0.0105950832366943
Differential Expression Analysis - DONE
Applied reordering to clusterization is:
1 -> 1, 2 -> 2
Total calculations elapsed time: 26.4340019226074
Merging cells' uniform clustering: DONE
Applied reordering to clusterization is:
1 -> 1, 2 -> 2
Log Fold Change Analysis - START
* Analysis of cluster: '1'
* Analysis of cluster: '2'
Total calculations elapsed time: 0.90746283531189
Log Fold Change Analysis - DONE
Tested cluster: 1Asked to drop 0 genes and 501 cells
COTAN dataset analysis: START
Asked to drop 16 genes and 0 cells
Genes/cells selection done: dropped [16] genes and [0] cells
Working on [584] genes and [499] cells
Dataset cleaning elapsed time: 0.435135126113892
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 10 iterations
Total calculations elapsed time: 0.877191066741943
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0608154544840047 | max: 1260.06995351592 | % negative: 35.6164383561644
Model parameter estimation elapsed time: 1.28913187980652
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 1.42584204673767
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.0024878978729248
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0162339210510254
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.42595100402832
Total calculations elapsed time: 1.87051486968994
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 2.27803802490234
Dataset analysis elapsed time: 4.00230503082275
COTAN dataset analysis: DONE
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0152161121368408
Calculate `GDI`: DONE
Total calculations elapsed time: 0.469007968902588
Calculate GDI dataframe: DONE
Initializing `COTAN` meta-data
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Clean plots: START
PCA: START
PCA: DONE
Hierarchical clustering: START
Hierarchical clustering: DONE
Total calculations elapsed time: 0.924001216888428
Clean plots: DONE
Initializing `COTAN` meta-data
COTAN dataset analysis: START
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Dataset cleaning elapsed time: 0.427795886993408
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 0.870386838912964
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916524 | max: 462.908586418992 | % negative: 17.3333333333333
Model parameter estimation elapsed time: 1.32300400733948
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 1.72445797920227
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.00362014770507812
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0272798538208008
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.423411130905151
Total calculations elapsed time: 2.1787691116333
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 2.60260510444641
Dataset analysis elapsed time: 4.3534049987793
COTAN dataset analysis: DONE
Heatmap plot: START
Hangling COTAN object with condition: test
Using S
Calculating S: START
Calculating S: DONE
calculating PValues: START
Get p-values on a set of genes on columns and on a set of genes on rows
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.00202488899230957
calculating PValues: DONE
Handling genes type: G1
Handling genes type: G2
Handling genes type: G3
min COEX: -0.14844485428853 max COEX: 0.138918385916637
Total calculations elapsed time: 0.0245959758758545
Heatmap plot: DONE
Using S
Calculating S: START
Calculating S: DONE
calculating PValues: START
Get p-values genome wide on columns and genome wide on rows
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0486609935760498
calculating PValues: DONE
Using S
Calculating S: START
Calculating S: DONE
calculating PValues: START
Get p-values genome wide on columns and genome wide on rows
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0467369556427002
calculating PValues: DONE
Using S
Calculating S: START
Calculating S: DONE
calculating PValues: START
Get p-values genome wide on columns and genome wide on rows
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.047199010848999
calculating PValues: DONE
Using S
Calculating S: START
Calculating S: DONE
calculating PValues: START
Get p-values genome wide on columns and genome wide on rows
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.056300163269043
calculating PValues: DONE
Calculate cells' COEX (legacy): START
Retrieving expected cells' contingency table
calculating NN.. done
calculating YN..NY..YY..t().. done
Expected cells' contingency table elapsed time: 1.97436785697937
Calculating cells' COEX normalization factor
Calculate cells' normalization factor elapsed time: 0.0070950984954834
Retrieving observed cells' yes/yes contingency table
calculating YY.. done
Observed cells' contingency table elapsed time: 0.0678510665893555
Estimating cells' COEX
Calculate cells' COEX elapsed time: 0.42349100112915
Total calculations elapsed time: 2.47280502319336
Calculate cells' COEX (legacy): DONE
Initializing `COTAN` meta-data
COTAN dataset analysis: START
Genes/cells selection done: dropped [0] genes and [0] cells
Working on [600] genes and [1000] cells
Dataset cleaning elapsed time: 0.440821170806885
Estimate `dispersion`: START
Effective number of cores used: 1
Executing 1 genes batches
Parallel dispersion Newton-Raphson: used up to 7 iterations
Total calculations elapsed time: 0.928844928741455
Estimate `dispersion`: DONE
Estimate `dispersion`: DONE
`dispersion` | min: -0.0529252975916524 | max: 462.908586418992 | % negative: 17.3333333333333
Model parameter estimation elapsed time: 1.33991479873657
COTAN genes' COEX estimation: START
While trying to load the `torch` library Error in doTryCatch(return(expr), name, parentenv, handler): The `torch` library is installed but the required additional libraries are not available yet
Calculate genes' COEX (legacy): START
Retrieving expected genes' contingency table
calculating NN.. done
calculating NY..YN..YY..t().. done
Expected genes' contingency table elapsed time: 1.70005083084106
Calculating genes' COEX normalization factor
Calculate genes' normalization factor elapsed time: 0.0025629997253418
Retrieving observed genes' yes/yes contingency table
calculating YY.. done
Observed genes' contingency table elapsed time: 0.0256979465484619
Estimating genes' COEX
Calculate genes' COEX elapsed time: 0.444799184799194
Total calculations elapsed time: 2.17311096191406
Calculate genes' COEX (legacy): DONE
Only genes' COEX elapsed time: 2.61955308914185
Dataset analysis elapsed time: 4.4002890586853
COTAN dataset analysis: DONE
Differential Expression Analysis - START
* DEA on cluster 'H' with 500 cells
* DEA on cluster 'L' with 500 cells
Total calculations elapsed time: 0.0153980255126953
Differential Expression Analysis - DONE
Differential Expression Analysis - START
* DEA on cluster 'H' with 500 cells
* DEA on cluster 'L' with 500 cells
Total calculations elapsed time: 0.0103590488433838
Differential Expression Analysis - DONE
Differential Expression Analysis - START
* DEA on cluster 'H' with 500 cells
* DEA on cluster 'L' with 500 cells
Total calculations elapsed time: 0.0101380348205566
Differential Expression Analysis - DONE
Differential Expression Analysis - START
* DEA on cluster 'H' with 500 cells
* DEA on cluster 'L' with 500 cells
Total calculations elapsed time: 0.0102088451385498
Differential Expression Analysis - DONE
Elaborating Reduced dimensionality Data Matrix - START
Elaborating COEX Eigen Vectors - START
Elaborating COEX Eigen Vectors - DONE
Total calculations elapsed time: 1.41957211494446
Elaborating Reduced dimensionality Data Matrix - DONE
UMAP plot: START
Calculating UMAP: START
19:03:53 UMAP embedding parameters a = 0.9922 b = 1.112
19:03:53 Read 1000 rows and found 5 numeric columns
19:03:53 Using Annoy for neighbor search, n_neighbors = 30
19:03:53 Building Annoy index with metric = cosine, n_trees = 50
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
19:03:54 Writing NN index file to temp file /var/folders/r0/l4fjk6cj5xj0j3brt4bplpl40000gt/T//RtmpOjTfuA/file11e4235ec5ce
19:03:54 Searching Annoy index using 1 thread, search_k = 3000
19:03:54 Annoy recall = 100%
19:03:54 Commencing smooth kNN distance calibration using 1 thread with target n_neighbors = 30
19:03:55 Initializing from normalized Laplacian + noise (using RSpectra)
19:03:55 Commencing optimization for 500 epochs, with 37354 positive edges
19:03:55 Using rng type: pcg
Using method 'umap'
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
19:03:56 Optimization finished
Calculating UMAP: DONE
Total calculations elapsed time: 2.89352297782898
UMAP plot: DONE
Elaborating Reduced dimensionality Data Matrix - START
Running genes' selection: START
Calculate GDI dataframe: START
Using S
Calculating S: START
Calculating S: DONE
Calculate `GDI`: START
Effective number of cores used: 1
Executing 1 genes batches
Total calculations elapsed time: 0.0150411128997803
Calculate `GDI`: DONE
Total calculations elapsed time: 0.475162982940674
Calculate GDI dataframe: DONE
Selected 100 genes using HGDI selector
Running genes' selection: DONE
Elaborating PCA - START
Elaborating PCA - DONE
Total calculations elapsed time: 1.37871098518372
Elaborating Reduced dimensionality Data Matrix - DONE
UMAP plot: START
Calculating UMAP: START
19:03:58 UMAP embedding parameters a = 0.9922 b = 1.112
19:03:58 Read 1000 rows and found 5 numeric columns
19:03:58 Using Annoy for neighbor search, n_neighbors = 30
19:03:58 Building Annoy index with metric = cosine, n_trees = 50
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
19:03:58 Writing NN index file to temp file /var/folders/r0/l4fjk6cj5xj0j3brt4bplpl40000gt/T//RtmpOjTfuA/file11e4220cde69
19:03:58 Searching Annoy index using 1 thread, search_k = 3000
19:03:58 Annoy recall = 100%
19:03:58 Commencing smooth kNN distance calibration using 1 thread with target n_neighbors = 30
19:03:59 Found 2 connected components, falling back to 'spca' initialization with init_sdev = 1
19:03:59 Using 'irlba' for PCA
19:03:59 PCA: 2 components explained 86.78% variance
19:03:59 Scaling init to sdev = 1
19:03:59 Commencing optimization for 500 epochs, with 36742 positive edges
19:03:59 Using rng type: pcg
Using method 'umap'
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
19:04:01 Optimization finished
Calculating UMAP: DONE
Total calculations elapsed time: 2.88599991798401
UMAP plot: DONE
Dispersion bisection: straddling used 2 iterations
Dispersion bisection: used 8 iterations
Dispersion bisection: straddling used 1 iterations
Dispersion bisection: used 9 iterations
Dispersion Newton-Raphson: used up to 4 iterations
Dispersion Newton-Raphson: used up to 4 iterations
parallel dispersion bisection: straddling used up to 2 iterations
Parallel dispersion bisection: used up to 9 iterations
Parallel dispersion Newton-Raphson: used up to 4 iterations
[ FAIL 0 | WARN 3 | SKIP 0 | PASS 632 ]
[ FAIL 0 | WARN 3 | SKIP 0 | PASS 632 ]
>
> proc.time()
user system elapsed
308.461 1.337 311.372
COTAN.Rcheck/COTAN-Ex.timings
| name | user | system | elapsed | |
| COTAN_Legacy | 0.000 | 0.000 | 0.001 | |
| COTAN_ObjectCreation | 4.073 | 0.035 | 4.113 | |
| CalculatingCOEX | 21.916 | 0.027 | 21.979 | |
| ClustersList | 0.003 | 0.000 | 0.003 | |
| Conversions | 2.051 | 0.005 | 2.068 | |
| GenesStatistics | 4.839 | 0.012 | 4.853 | |
| HandleMetaData | 0.010 | 0.001 | 0.011 | |
| HandlingClusterizations | 17.855 | 0.066 | 17.948 | |
| HandlingConditions | 0.011 | 0.002 | 0.012 | |
| HeatmapPlots | 13.389 | 0.045 | 13.470 | |
| Installing_torch | 0 | 0 | 0 | |
| LoggingFunctions | 0.001 | 0.001 | 0.002 | |
| ParametersEstimations | 9.038 | 0.013 | 9.068 | |
| RawDataCleaning | 1.878 | 0.027 | 1.896 | |
| RawDataGetters | 0.011 | 0.000 | 0.011 | |
| UniformClusters | 26.117 | 0.106 | 26.219 | |
| getColorsVector | 0 | 0 | 0 | |