utopiah
/
text-code-xr-engine
1
0
Fork 0
Code Issues 81 Pull Requests Projects Releases Wiki Activity
Labels Milestones
New Issue

spacialized virtual KVM #56

Open
opened 2 years ago by utopiah · 8 comments
utopiah commented 2 years ago
Owner

Generalize triggerbox, see e.g #28 , based on position of other devices, in particular their screen.

Related past explorations

See also the import/export label for issues https://git.benetou.fr/utopiah/text-code-xr-engine/issues?labels=25

Generalize triggerbox, see e.g https://git.benetou.fr/utopiah/text-code-xr-engine/issues/28 , based on position of other devices, in particular their screen. Related past explorations * remote keyboard https://git.benetou.fr/utopiah/text-code-xr-engine/issues/3 * outside of VR https://twitter.com/utopiah/status/1325206376742866944 * VR to eink https://twitter.com/utopiah/status/1250464627739279360 * screensharing (and potentially controlled even though not binded) https://twitter.com/utopiah/status/1567868019698810882 via noVNC See also the import/export label for issues https://git.benetou.fr/utopiah/text-code-xr-engine/issues?labels=25
utopiah added the
import/export
core interactions
 labels 2 years ago
utopiah commented 2 years ago
Poster
Owner

See also previous work on dragging iframes e.g https://fabien.benetou.fr/Wiki/MetaWhiteboard?action=whiteboard

Note that iframe as a solution is problematic as it does not work in WebXR and also means the state will not be preserved, unless done via URL parameters.

See also previous work on dragging iframes e.g https://fabien.benetou.fr/Wiki/MetaWhiteboard?action=whiteboard Note that iframe as a solution is problematic as it does not work in WebXR and also means the state will not be preserved, unless done via URL parameters.
utopiah commented 2 years ago
Poster
Owner

In this context provenance #20 is particularly important.

For example if one were to drag an item from the screenstack genator then drop it on another display, it could display that very item. Rather what it should do is display what it represents, namely in this context the URL of a wiki page, thus the page itself. If the target device of that display is able to do so it should open the page instead.

In this context provenance https://git.benetou.fr/utopiah/text-code-xr-engine/issues/20 is particularly important. For example if one were to drag an item from the `screenstack` genator then drop it on another display, it could display that very item. Rather what it should do is display what it represents, namely in this context the URL of a wiki page, thus the page itself. If the target device of that display is able to do so it should open the page instead.
utopiah commented 2 years ago
Poster
Owner

Consider also the Web Share API https://developer.mozilla.org/en-US/docs/Web/API/Web_Share_API and how a mobile is mostly a place of sharing text, including links, and thus how it translates there.

Consider also the Web Share API https://developer.mozilla.org/en-US/docs/Web/API/Web_Share_API and how a mobile is mostly a place of sharing text, including links, and thus how it translates there.
utopiah commented 2 years ago
Poster
Owner

Consider extending glTF for that.

It would allow to have the 3D representation of an object but also possibly a text description, HTTP interface, SWAGGER description of that API, etc.

This could faciliate discovery then composability.

See also current implementation of manipulation of containers, e.g https://twitter.com/utopiah/status/1533064468292419585 to faciliate the usage of externals resources (e.g CPU, RAM, GPU, disk, etc).

See also past IoT explorations via WebThings.

Note that from https://fabien.benetou.fr/Content/OnManagingInterfaces one would stick to HTTP and only fallback to other levels if need be, e.g WebDAV over sshfs.

Consider extending glTF for that. It would allow to have the 3D representation of an object but also possibly a text description, HTTP interface, SWAGGER description of that API, etc. This could faciliate discovery then composability. See also current implementation of manipulation of containers, e.g https://twitter.com/utopiah/status/1533064468292419585 to faciliate the usage of externals resources (e.g CPU, RAM, GPU, disk, etc). See also past IoT explorations via WebThings. Note that from https://fabien.benetou.fr/Content/OnManagingInterfaces one would stick to HTTP and only fallback to other levels if need be, e.g `WebDAV` over `sshfs`.
utopiah commented 2 years ago
Poster
Owner

See also Designing for serendipity: supporting end-user configuration of ubiquitous computing environments https://dl.acm.org/doi/abs/10.1145/778712.778736 on the value of going beyond "just" KVM.

Own perspective on interfaces, including https://twitter.com/utopiah/status/1568912887334174727 , Future of Text presentation, subsequent https://fabien.benetou.fr/Content/OnManagingInterfaces

See also Designing for serendipity: supporting end-user configuration of ubiquitous computing environments https://dl.acm.org/doi/abs/10.1145/778712.778736 on the value of going beyond "just" KVM. Own perspective on interfaces, including https://twitter.com/utopiah/status/1568912887334174727 , Future of Text presentation, subsequent https://fabien.benetou.fr/Content/OnManagingInterfaces
utopiah commented 2 years ago
Poster
Owner

Offline version based on history, e.g ~/.bashrc shortcuts on last reMarkable pages or NAS photos or browsing history (cf tweet), could already be very useful.

Offline version based on history, e.g ~/.bashrc shortcuts on last reMarkable pages or NAS photos or browsing history (cf tweet), could already be very useful.
utopiah commented 2 years ago
Poster
Owner

Try sshfs mounts within WebDAV server with additional metadata e.g screencapture of last live session and last known IP with timestamp.

Try sshfs mounts within WebDAV server with additional metadata e.g screencapture of last live session and last known IP with timestamp.
utopiah commented 2 years ago
Poster
Owner

See https://git.benetou.fr/utopiah/offline-octopus

See https://git.benetou.fr/utopiah/offline-octopus
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
artemis-example
assymetric-collaboration
avatar-controlled
bind-jxr-target
book
browser-clipboard
chemistry_example
citations
code-editor
code-generation
componentized
componentized-blocks
control-points
core-vs-extras
direct-scaling
draw2d-with-lines
editor-split
emptyview
federation
fosdem-presentation
fossxr
fot-json-andrew
fot-sloan-companion
game-mechanics
game-multiple-levels
game-remote-save
game-template-with-asset-validator
gesture-manager
gltf-jxr
graph
hands-controllers-kbd
in-situ-instructions
keyboardless-jxr-editing
knuckle-code-snippets
knuckle-docs
laser-fallback
layer
level-loader
list-editing
mannequin
master
meshing
microgestures
minimalist-template
minimum
mistral-and-graphhopper
motionstick
nodal
ondrop
ontouch
outline-extrude
physics
pinch-to-menu
primitives_as_set
pseudoreamls-as-scaffoldings
pull-to-value
reader
readibility-background
real-world-meshing
scaffolding
scaffolding-video-background
scaled-linked-editor
screenshot
spatial-introspection
speech
stretch-to-unpack
stt
swagger_example
syntax-highlighting
teleport
textgame
tiles
trail
visibile-scaffolding
visual-tension
warmup
webchuck
webdav
webmidi
webxrsyskbd
wllama
xr-to-2D-board
Labels
Apply labels
Clear labels
bug
Something is not working core interactions
Ways to interact with content that actually makes this scaffolding unique and aligned with its main value of efficient exploration of interfaces. demo
focusing on facilitating face to face or remote demonstration documentation duplicate
This issue or pull request already exists enhancement
New feature help wanted
Need some help import/export
Interactions with external content invalid
Something is wrong question
More information is needed wontfix
This won't be fixed
No Label bug core interactions demo documentation duplicate enhancement help wanted import/export invalid question wontfix
Milestone
Set milestone
Clear milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Assign users
Clear assignees
No Assignees
1 Participants
Notifications
Due Date

No due date set.

Dependencies

No dependencies set.

Reference: utopiah/text-code-xr-engine#56
Write Preview
Loading…
Cancel
Save
There is no content yet.
Delete Branch '%!s(<nil>)'

Deleting a branch is permanent. It CANNOT be undone. Continue?

No
Yes