Author Topic: Structurising a texture library  (Read 5097 times)

2017-12-19, 17:41:53

mase

  • Active Users
  • **
  • Posts: 32
    • View Profile
So I have been collecting various textures for quite some time now and was never sure what is the best system to keep everything organized and quick to use. My current setup is that I have one folder called '_previews' where I have all the texture categories (brick, metal, wood, grunge, etc.) with their sub-categories and I only keep my diffuse textures here. Then I have the same category-tree in a folder called '_maps' where I put all the other maps (like gloss, bump, displacement, etc.) so if I find the diffuse I like, I change '_previews' to '_maps' in the folder path and get into the same folder except instead of diffuse I see other maps of those textures.

It takes so much time to sort every new collection to their actual folders and to separate each diffuse from other maps. On the other hand, when I'm browsing for textures, I don't need to click 4-5 times just to see another diffuse texture so it really helps.

As of right now, my texture library weights about 300gb and I'm already struggling a bit. But I believe professional freelancers or big offices must have much more and was wondering what system do they use to keep it nice and simple. I know Windows explorer might not be the best way to organize a file library but so far I haven't been able to find a better solution to this problem so I'm sticking to whatever works best.

2017-12-19, 18:20:58
Reply #1

Juraj Talcik

  • Active Users
  • **
  • Posts: 3398
  • Tinkering away
    • View Profile
    • studio website
I am in to hear the answers :- ).

On top of stuff you mention I have issue with keeping 'legacy' (whathever random crap I needed at some point) and 'production' (Tiled, PBR-ready, with sub-maps) together in same folder because only I know which one sucks and which one doesn't.
The rest of my team is utterly lost in which textures they're supposed to use.
I occasionally send 'legacy' into 'legacy' sub-folder to die (and re-link former scenes if I need to use them in future), but I keep adding new crappy ones alongside. I can't stop myself from differentiating between temporary and pristine organized.

One (but partial only) solution is that I try to build basic materials for Connector library instead of relying on textures. If I or someone from my team needs 'White Oak' they will grab ready-to-use material with all sub-textures inside it and they can continue to combine it in some way.


Age old mantra: Waste time organising stuff forever ? Or waste time trying to find stuff each time. It just might be possible that in the end the net result is the same.
talcikdemovicova.com  Website and blog
be.net/jurajtalcik    My Behance portfolio
lysfaere.com   Something new

2017-12-20, 08:47:33
Reply #2

mase

  • Active Users
  • **
  • Posts: 32
    • View Profile
On top of stuff you mention I have issue with keeping 'legacy' (whathever random crap I needed at some point) and 'production' (Tiled, PBR-ready, with sub-maps) together in same folder

This. I believe your way of putting production textures into materials and then keeping all the other ones aside might be a good option. Although it takes even more time than putting everything into a system of some sort, it might be worth it in the end.

Age old mantra: Waste time organising stuff forever ? Or waste time trying to find stuff each time. It just might be possible that in the end the net result is the same.

I think this depends on a person/office structure. In my opinion, having a clear file structure means having a clear mind. On the other hand, others prefer a more chaotic creative workflow so I guess there's no one answer to this question.

2017-12-20, 10:35:30
Reply #3

romullus

  • Global Moderator
  • Active Users
  • ****
  • Posts: 5367
  • Let's move this topic, shall we?
    • View Profile
    • My Models
If i would be in need to organize my assets, i would probably go the tagging way. Takes much time to properly tag every asset, but then makes your work with them like a breeze.
I'm not Corona Team member! Everything i say, is my personal opinion only. Render Legion does not endorse my words nor actions.

2017-12-20, 12:37:19
Reply #4

mase

  • Active Users
  • **
  • Posts: 32
    • View Profile
I also heard much about tagging but isn't it done in some 3rd party software? If so, which one?

2017-12-20, 15:02:37
Reply #5

romullus

  • Global Moderator
  • Active Users
  • ****
  • Posts: 5367
  • Let's move this topic, shall we?
    • View Profile
    • My Models
If only for tags, i like Adobe Lightroom the most, but it's not suitable to work with CG assets, so i chose Connecter. It's free, it's actively maintained and it gets better with each update.
I'm not Corona Team member! Everything i say, is my personal opinion only. Render Legion does not endorse my words nor actions.

2017-12-20, 15:28:17
Reply #6

Juraj Talcik

  • Active Users
  • **
  • Posts: 3398
  • Tinkering away
    • View Profile
    • studio website
I am currently contemplating on tagging my models as 3rd tier of organising. To me it's more of a search feature than division.

In Connector it would look followingly:

1st tier: 'Folder' structure (taken from file explorer): Beds/Chairs/Bookcases/Decorations/etc..
2nd tier: 'Categories' (items from single folder in multiple categories): Kitchen armchairs, Midcentury archchairs, Scandinavian Decoration, Kitchen Decoration,etc..
3rd tier: Tags: Chair (Armchair, wooden, scandinavian, midcentury, old, PBR,...)

Now perhaps this is how I should approach the textures the same way. The good thing about Categories and Tags is that they are virtual feature outside of physical disc hierarchy so they are flexible to crate and change, and don't affect filepaths.

I think that might be it for me. I once contemplated tagging inside Adobe Bridge but I couldn't get used to having both Bridge and File explorer open at same time. But now with 3rd monitor, Connector will be always ON.
talcikdemovicova.com  Website and blog
be.net/jurajtalcik    My Behance portfolio
lysfaere.com   Something new

2017-12-20, 16:58:14
Reply #7

mase

  • Active Users
  • **
  • Posts: 32
    • View Profile
I never really looked into Connecter, thanks for pointing that out. It really seems to do a lot of work, will give it some time over the weekend.

Juraj, that seems to be the right way of putting things in order. You need proper folder structure but you also need tags. Can Connecter be used for textures as well as models? That would be great.

2017-12-20, 19:13:33
Reply #8

Juraj Talcik

  • Active Users
  • **
  • Posts: 3398
  • Tinkering away
    • View Profile
    • studio website
Connecter can be used for pretty much anything it really revolutionized our workflow.

I use it currently for Models, IES, HDRi and building material library. But I know Daniel Reutersward and others use it for textures too I think.

The most incredible tool I use from it is auto-generating the assets. I simply unpack .zip file from 3dSky/DesignConnected/etc..., then drag&drop it into 3dsMax viewport and with menu pop-up it will put it into folder structure (generating "/maps" subfolder and putting all textures there, auto-relinking them), into categories you place, description you write for it, generate a thumbnail file from studio scene I prepared. I also set it up to convert it to Corona :- ).

I was part of private dev chat for more than a year I think now and the devs are very motivated and user-request listening. Some of the stuff Swedish boys asked for is almost ridiculous and everything gets implemented next week :- ).
talcikdemovicova.com  Website and blog
be.net/jurajtalcik    My Behance portfolio
lysfaere.com   Something new

2017-12-21, 00:29:18
Reply #9

lupaz

  • Active Users
  • **
  • Posts: 258
    • View Profile
Thanks! I didn’t know about comnecter either

2017-12-21, 08:04:27
Reply #10

mase

  • Active Users
  • **
  • Posts: 32
    • View Profile
That is great stuff, can't wait for the weekend to really mess with this thing.

On a related note, do you also use this for your material library? I've had great success with CMPP and was wondering if I should transfer it into Connecter.

2017-12-21, 09:30:50
Reply #11

romullus

  • Global Moderator
  • Active Users
  • ****
  • Posts: 5367
  • Let's move this topic, shall we?
    • View Profile
    • My Models
The most incredible tool I use from it is auto-generating the assets. I simply unpack .zip file from 3dSky/DesignConnected/etc..., then drag&drop it into 3dsMax viewport and with menu pop-up it will put it into folder structure (generating "/maps" subfolder and putting all textures there, auto-relinking them), into categories you place, description you write for it, generate a thumbnail file from studio scene I prepared. I also set it up to convert it to Corona :- ).

Wow, i didn't even know that all of this is possible with Connecter. Definitely worth to look deeper.
I'm not Corona Team member! Everything i say, is my personal opinion only. Render Legion does not endorse my words nor actions.

2017-12-21, 09:56:59
Reply #12

johan belmans

  • Primary Certified Instructor
  • Active Users
  • ***
  • Posts: 719
    • View Profile
    • belly.be
The most incredible tool I use from it is auto-generating the assets. I simply unpack .zip file from 3dSky/DesignConnected/etc..., then drag&drop it into 3dsMax viewport and with menu pop-up it will put it into folder structure (generating "/maps" subfolder and putting all textures there, auto-relinking them), into categories you place, description you write for it, generate a thumbnail file from studio scene I prepared. I also set it up to convert it to Corona :- ).

Wow, i didn't even know that all of this is possible with Connecter. Definitely worth to look deeper.

Yep,we will dive deeper in connector too. It changed our workflow tremendously.
Hopefully they will develop integration for Cinema 4D. As this is will be the DCC package at the moment for us to replace MAX in the future.

2017-12-21, 11:50:58
Reply #13

nkilar

  • Active Users
  • **
  • Posts: 698
    • View Profile
    • My personal website
Yep,we will dive deeper in connector too. It changed our workflow tremendously.
Hopefully they will develop integration for Cinema 4D. As this is will be the DCC package at the moment for us to replace MAX in the future.

Cinema 4D has a fairly good content browser that allows for saving of assets - it saves them all in a lib4d file which can get super huge but its very useful. I hope you've explored that option. It is however obviously not as advanced as the connector :)

2017-12-21, 12:02:34
Reply #14

johan belmans

  • Primary Certified Instructor
  • Active Users
  • ***
  • Posts: 719
    • View Profile
    • belly.be
Yep,we will dive deeper in connector too. It changed our workflow tremendously.
Hopefully they will develop integration for Cinema 4D. As this is will be the DCC package at the moment for us to replace MAX in the future.

Cinema 4D has a fairly good content browser that allows for saving of assets - it saves them all in a lib4d file which can get super huge but its very useful. I hope you've explored that option. It is however obviously not as advanced as the connector :)

Hi Niklar, thanks for the tip!